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Abstract. Non-traditional thermodynamics, applied to random behaviour 
associated with turbulence, mixing and competition, is reviewed and analysed. 
Competitive mixing represents a general framework for the study of generic 
properties of competitive systems and can be used to model a wide class 
of non-equilibrium phenomena ranging from turbulent premixed flames and 
invasion waves to complex competitive systems. We demonstrate consistency 
of the general principles of competition with thermodynamic description, review 
and analyse the related entropy concepts and introduce the corresponding 
competitive H-theorem. A competitive system can be characterised by a 
thermodynamic quantity — competitive potential — which determines the 
likely direction of evolution of the system. Contested resources tend to move 
between systems from lower to higher values of the competitive potential. 
There is, however, an important difference between conventional thermodynamics 
and competitive thermodynamics. While conventional thermodynamics is 
constrained by its zcroth law and is fundamentally transitive, the transitivity of 
competitive thermodynamics depends on the transitivity of the competition rules. 
Intransitivitics arc common in the real world and are responsible for complex 
behaviour in competitive systems. 

This work follows the ideas and methods that arc originated in analysis 
of turbulent combustion but reviews a much broader scope of issues linked to 
mixing and competition, including thermodynamic characterisation of complex 
competitive systems with self-organisation. The approach presented here is 
interdisciplinary and is addressed to a general educated reader, while the 
mathematical details can be found in the Appendices. 
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1. Introduction 

Thermodynamics allows for a concise description of complex stochastic systems, 
determining an overall trend behind a large number of random events and offering 
insightful generalisations. The success of classical thermodynamics is largely based on 
recognising and postulating irreversibility of the surrounding world that on one hand 
represents an obvious fact and on the other hand still awaits explanation from the first 
principles of physics. The second law of thermodynamics, which predicts irreversible 
increase of entropy — the key thermodynamic quantity serving as a measure of chaotic 
uncertainty — is equally applicable to a small combustor and to stars and galaxies. 

This remarkable success of thermodynamics can not hide from us its major 
difficulty - our world appears to be much more complicated and much less chaotic 
than generally might be inferred from the second law. It is well known that complex 
non-equilibrium stochastic processes tend to display a significant level of regularity 
along with randomness [T] . In non-equilibrium phenomena, the production of physical 
entropy is typically high, in perfect agreement with the laws of thermodynamic. 
Although no direct violation of the laws of thermodynamics is known, thermodynamics 
struggles to explain complexity, which is often observed in essentially non-equilibrium 
phenomena: turbulent mixing and combustion as well as evolution of life forms may 
serve as typical examples. The entropy of turbulent fluctuations does not seem to 
be maximal and the same applies to entropies characterising distributions in other 
complex non-equilibrium processes. These entropies have similarities with but are 
not the same as the molecular entropy, which characterises disorder of molecular 
movements and is subject to the laws of thermodynamics. We use the term apparent 
entropy to distinguish entropy-like quantities from the molecular entropy. 

The present work reviews the use of entropy in the analysis of turbulence, 
turbulent mixing and combustion and shows that the term "entropy" is commonly 
used to denote both apparent entropy and molecular entropy. The same trend can 
be observed across other disciplines. In principle, the use of apparent entropy may 
or may not imply the existence of underlying thermodynamics. The existence of 
apparent thermodynamics associated with mixing is of prime interest for this work. 
Thermodynamic description is a very general methodology involving abstract theories, 
i.e. theories not directly linked to the dynamics of molecules. The general theory 
of Gibbs measures [2] and the axiomatic thermodynamic theory [3], introducing 
entropy on the basis of ordering of thermodynamic states by Caratheodory's adiabatic 
accessibility (4,, should be mentioned in this respect. 

Competitive systems, which are typically associated with complex stochastic 
behaviour, are common in the real world. Abstract competition, which studies generic 
principles of competition in their most abstract form, can be interpreted as a form of 
mixing [5] . This mixing, which is called competitive mixing, can be used to characterise 
various processes: turbulent combustion, invasion waves and other related phenomena 
[5] . Unlike conventional conservative mixing, competitive mixing can display complex 
behaviour with sophisticated interdependencies. After reviewing existing publications 
and taking into account a number of theorems presented in the Appendices, we 
demonstrate that competitive systems do allow for a thermodynamic description. The 
implications of this demonstration are profound: the evolution of competitive systems 
occurs in a stochastic manner but in agreement with competitive thermodynamics. 
A competitive system can be characterised by competitive entropy and by a new 
thermodynamic quantity — the competitive potential — which determines the likely 
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direction of evolution of the system and is analogous to chemical potential in 
conventional thermodynamics (taken with the opposite sign). Following in the 
footsteps of classical thermodynamics, competitive thermodynamics recognises the 
obvious trend towards more competitive states while the details of the mechanism 
behind the competition rules may remain unknown. 

Competitive thermodynamics, while answering many existing questions, poses 
several new ones. A conventional thermodynamic system evolves towards equilibrium 
and, once the global equilibrium is reached remains in this state indefinitely. 
Competitive systems tend to display much more complex and unending pattern of 
evolution — how this can be consistent with a thermodynamic description? The 
answer lies in the details. Competitive thermodynamics has a principal difference with 
conventional thermodynamics: transitivity of competitive thermodynamics can not be 
taken for granted. While conventional thermodynamics is constrained by its zeroth 
law and is fundamentally transitive, the transitivity of competitive thermodynamics 
depends on the transitivity of the competition rules. Intransitivities are not only 
possible in real competitive systems, but seem to be quite common. Unlike chemical 
potential or temperature, which can be assigned absolute values, the competitive 
potential becomes relative and this removes the rigid constraints of conventional 
thermodynamics and introduces complex patens into evolution. Intransitivity, which 
has long been known in science under the name of the Condorcet paradox [7] and 
has traditionally been considered as something paradoxical, abnormal or unwanted, is 
viewed here as a common property of nature. 

The approach presented here is derived from the long-standing tradition of 
modelling turbulent reacting flows repeatedly reviewed in publications [81-fTS]. The 
rapid development over the last few decades of computational models designed for the 
simulation of transport, reaction and dispersion in turbulent flows has led to a wide use 
of Pope particles [H [19] . These notional particles move in physical space and posses a 
set of properties that can be changed due to 1) kinetic evolution within each particle 
and 2) mixing exchanges between the particles. With the introduction of competitive 
mixing. Pope particles can be viewed not only as being effective tools for modelling of 
turbulent reacting flows but also as universal building blocks for a wide class of models 
that can simulate complex behaviour. Conventional conservative mixing does not 
result in significant stochastic interdependencies between the particles and a system of 
many particles can be characterised by a single one-particle pdf. If conventional mixing 
is replaced by competitive mixing, these interdependencies may become significant, 
dramatically increasing the effective dimensionality and complexity of the simulations. 
Competitive mixing naturally appears in simulations of turbulent premixed flames [S] , 
which are driven by the forces of conventional thermodynamics. We review these 
applications and take the logical step of extending these thermodynamic descriptions 
to more complex competitive systems. There is a large number of publications 
dedicated to different aspects of complexity, for example, algorithmic (Kolmogorov- 
Chaitin) complexity and algorithmic entropy [20], complex adaptive systems (CAS) 
[2n [22] and evolution of complexity 23' . 

The phenomena we consider display a combination of chaotic and ordered 
behaviour. Entropy, which is conventionally used to characterise the balance of 
order and disorder, has been repeatedly applied to the analysis of non-equilibrium 
systems in general and turbulent flows in particular [50^136] . Our treatment 

of non-equilibrium processes is based on introducing non-conventional or apparent 
thermodynamics, which is not analogous to but still may have some links with the 
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principles of non-equilibrium thermodynamics (i.e. entropy production principles of 
Prigogine [53] and Ziegler and the fluctuation theorem [17]). This work follows 
the application of the concept of entropy to semi-autonomous elements, which in most 
cases can be effectively represented by Pope particles. 

In accordance with the "Turbulent Mixing and Beyond" tradition, the review 
starts from the methods used in modelling of turbulent mixing and combustion and 
then extends these methods beyond turbulence to mixing and competitive systems 
of a general nature. The possibility of thermodynamic description is sought and, in 
many cases, found for these systems. While the thermodynamic description of mixing, 
both conservative and competitive, is the focus of the present work, the other areas 
are covered as necessary but only to the extent of their relevance to the main topic. 

The review is divided into 8 sections and 4 appendices. The sections present the 
following material: 

• Section 2 defines entropy for systems of notional particles. The defined entropy 
involves two major components: configurational (related to collective particle 
disorder) and potential (related to the state of each particle). The use of particle 
entropy in context of turbulent flows is subsequently reviewed. 

• Section 3 analyses the effect of conservative and competitive mixing on entropy. 
Conventional conservative mixing models, which are commonly used in modelling 
of transport and reactions in turbulent flows, are reviewed and the condition 
that enforces conservative mixing to be entropy-consistent is presented. The 
conventional entropy of premixed combustion is extended (as apparent entropy) 
to become a common property of systems involving competitive mixing. 

• Section 4 explores the fundamental link between ordering, ranking and entropy. 
The analysis is directed at competitive mixing but the related methodologies 
developed in other disciplines (adiabatic accessibility and economic utility) are 
also reviewed. 

• Section 5 analyses the behavior of systems with transitive competition and 
shows that it is thermodynamically consistent. The thermodynamic analogy 
is especially strong for the class of mutations that is called Gibbs mutations 
by analogy with Gibbs measures. A transitive competitive system tend to 
promptly reach a quasi-equilibrium state and then slowly drift in the direction 
of increasing competitiveness. Both processes are characterised by increase in 
apparent entropy. 

• Section 6 investigates a more complex case of intransitive competition. Thermo- 
dynamic considerations can be applicable if intransitive competition retains some 
transitive properties. The applicability of competitive thermodynamics to general 
intransitive systems, which may involve competitive cooperation and other forms 
of complex behaviour, is also explored. 

• Section 7 gives several examples of intransitive behaviour including intransitivity 
in turbulent flows, in chemical reactions and in a generic competitive system 
displaying complex behaviour. 

• Section 8 outlines the main conclusions for this work. 

• Apendices present useful mathematical details and additional material, which 
is not available in the published literature but is essential to this review: 

— Appendix A gives a brief summary of the related mathematical results. 
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— Appendix B generalises ranicings for preferential mixing 

— Appendix C introduces Gibbs and near-Gibbs mutations and explores 
their relations with Markov processes, Gibbs measures and the fluctuation 
theorem. 

— Appendix D presents governing equations, general theorems and analysis 
of some special cases for evolution of competitive systems. 



2. Entropy of particle systems 

Although entropy was introduced in thermodynamics and statistical physics by 
Clausius, Boltzmann and Gibbs as a specific, heat-related property of large systems 
of molecules, the modern use of this term ranges from rigorous extensions of the 
concept of entropy (such as Shannon's entropy in information theory) to relatively 
vague and intuitive interpretations (such as social entropy). The more general view 
of entropy, which takes its origin in Shannon's famous work [37] . sees entropy as a 
property characterising disorder of stochastic behaviour in general. In the present 
we understand entropy as a quantity which displays (or is expected to display) 
behavior similar to that of the molecular entropy. This entropy, though, does not 
necessarily coincide with the molecular entropy used in conventional thermodynamics 
and the word apparent is used whenever it is necessary to stress this difference. 
Thermodynamic quantities introduced for competitive systems can be also named 
as competitive. In this section, common definitions of entropy for a system of notional 
particles are considered. 



2.1. Configurational entropy and potential entropy 

Consider n notional stochastic particles, where each of these particle is characterised 
by a vector X = {X'^^\ X^'^''^). The joint probability distribution of these particles 
is denoted by P„ = P„(Xi, X„). The Gibbs entropy is introduced as a statistical 
sum (or integral) over all possible states of this system 

S = J (^-P„ln(^^^ +P„s„^dXi...dX„, (1) 

where An can be interpreted as a priori statistical weight characterising effective 
volumes in the parameter space. This definition is conventional |33| but includes 
an additional term P„s„, which is considered below. If the particles are (or can be 
treated as) statistically independent then the joint pdf (probability density function) 
is decomposed into single-particle pdfs 

P„ = P„(Xi,...,X„) =P(Xi)...P(X„), (2) 

and the equation for entropy takes the form of Boltzmann entropy 

S= -n f P(X)ln ( ) dX + n f P(X)s(X)dX (3) 

The first term Sc, which is called here configurational entropy, is related to the 
stochastic nature of the particles distribution while the second term Sf, which is 
called potential entropy, is related to the particle state and characterised by the 
entropy potential s(X). If we interpret the particles as computational objects, the 
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configurational entropy is the same as Shannon entropy of variable X. It is arguable 
that, if the particles are not distinguishable, the value ln(n!) nln(n) needs to 
be deducted from This however does not affect our considerations since the 

number of particles is kept constant. The entropy S can be interpreted as free 
entropy, defined a.s S — ~G/T where G is the Gibbs (or Helmholtz) free energy 
and T is the absolute temperature measured in energy units. In this case the physical 
interpretation of s(X) is most transparent and linked to free energy of each state 
X. The distinction between configurational and non-configurational free energies is 
commonly used in thermodynamic modelling [38j . In the present work, we do not 
restrict our consideration to a specific interpretation of S. Inclusion of a priori 
statistical weight ^(X) makes the definition of entropy invariant with respect to 
replacements of variables X. 

The Gibbs entropy and Boltzmann entropy are equivalent only if the particles 
are independent. The particles may display some dependence in case of conventional 
conservative mixing [3^ but these dependencies are typically small. As discussed 
in the following sections, complex particle behavior, which can be observed in the 
case of competitive mixing, may be accompanied by significant particle dependencies 
and substantial differences between the two definitions. In this case, however, Gibbs 
entropy becomes computationally intractable since the sum is to be evaluated over all 
alternative realizations in the overall composition space of very large dimension nxkd- 
Typically, these alternative realizations remain unknown in computations while the 
whole ensemble of realisations may be difficult to define for complex systems. Our 
analysis is largely based on Boltzmann entropy, which is evaluated using the discrete 
representation of the single-particle pdf -P(X) by the current distribution of n particles, 
where n is assumed to be large. Note that in complex systems the current distribution 
may fluctuate even if n is large. 

2.2. Entropy of Pope particles 

We now consider Pope particles and distinguish location of the particle denoted by 
x = (xi, Xfc^) and particle properties denoted by y = (yi, yky), that is X = (x, y) 
and kd = kx + ky. The variables xi^...,Xk^ represent physical coordinates and, 
possibly, other reference variables such as those used in MMC mixing [301 HI] . The 
coordinates x are conventionally governed by a Markov diffusion process while the 
particle properties y change due to mixing and, possibly, chemical reactions. With 
this distinction drawn between the physical coordinates x and particle properties y, 
we assume that entropy of the particle state s is dependent on particle properties y but 
not on particle coordinates x (that is particles are not placed in any force field acting 
in physical space). The entropy can be divided into volumetric and local S = 'S'(x) 
components according to 



S — n 




'5'(x) = / p(y|x)s(y)dy- / j3(y|x)ln 



^ oo ^ oo 
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The one-particle pdf P — P {y, x, t) governing distribution of Pope particles satisfies 
the equation [51 [31] 

'dP 

dt 



dt 



(4) 



where v is the velocity in physical space x, D is the diffusion coefficient in physical 
space, W^^"^ is the reaction rate and the term on right hand side symbolically represents 
the effect of mixing. After some conventional manipulations, differentiating equation 
^ results in 




dP 



dxdy+ 



dsjy) 



^(y) 



dP 



dydx, 



(5) 



where 



^ Pdiv (v) + £> 



(VPf 
P 



represents terms related to spatial inhomogeneity. The velocity divergence term was 
previously derived and investigated by Falkovich and Fouxon [33] , who concluded that 
this term may result in entropy extraction from the system to the environment. The 
effect of the second term is well known - this term contributes to generation of entropy 
|42| . In the present work we focus on the mixing term and its influence on entropy and 
mainly restrict our attention to a spatially homogenous and non-reacting case. The 
mixing operator is typically presumed to be localised in x-space and can be assumed to 
be non-preferential with respect to y. That is all particles are selected for mixing from 
a given location x with equal probability irrespective of their properties. The simplest 
mixing models are non-preferential but, in principle, modelling can be improved by 
exercising proper preferences during mixing. 



2.3. Maximal entropy distribution and competitive potential 

In the rest of the paper we denote P(y|x) — /(y) and consider only local characteristics 
so that the equation for the local entropy takes the form 



/(y)in(|^)^y 



/(y)s(y)rfy 



Sc Sf 

With the use of the equilibrium function /o(y) defined by 



/o(y) = ^exp(.(y)): 



where 



Z 



A(y)exp(s(y))dy 



is the partition function, the entropy equation takes the form 

.a/])^£/(y)(in(.)-in(|M)).y 



(6) 

(7) 
(8) 

(9) 
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The notation iS'([/]) is used to emphasise that 5 is a functional of the distribution 
/(y). Equation (|9| is similar to the KuUback-Leibler divergence [33], that is known 
to achieve global entropy maximum 

s{[M) = Hz) 

by the distribution /(y) = /o(y)- 

For competitive systems, we also introduce competitive potential x defined by 

where 

xo = HZ) - 1 (11) 

is the competitive potential of the equilibrium state. The constant of unity can be 
omitted from these equations. The a priori statistical weight ^(y) can be subject to 
different physical interpretations in competitive systems but it seems most logical to 
link A{y) to the probability distributions assuming that competition is switched off 
(i.e. to the a priori probability). Particles with fixed y can be treated as reactants with 
potential x while Xo represents the potential of the system composed from different 
equilibrated reactants. Note that /(y) should be multiplied by n, if the number of 
particles n may change. The competitive potential can be seen as a thermodynamic 
quantity which is similar to the chemical potential of reacting systems although 
X is defined with the opposite sign. The sign of x is selected to avoid a direct 
conflict with the common-sense interpretation of the expression of "having a high 
competitive potential" . This change in sign does not affect any physical properties 
of the system and is purely a notational matter. The similarity of competitive and 
chemical potentials is linked to the fact that it is the number of particles that is 
presumed to be preserved in interactions. Entropy combined with preservation of 
energy introduces the temperature. The particle systems considered here do not have 
temperature as long as there is no associated energy-like quantity that is conserved in 
mixing interactions. 

2.4- Entropy in studies of turbulent flows. 

In this section, we review the use of entropy in studies of turbulent flows revealing 
that different physical quantities or different conditions may in fact be implied when 
invoking this term. The molecular entropy has been used on numerous occasions 
to construct models of turbulent flows. The following examples indicate the wide 
scope of possible applications but, of course, are not intended as a comprehensive 
review of all possible applications. Molecular entropy can be used to characterise the 
spectrum of convective turbulence |44j , ensure consistency of models with the laws of 
thermodynamics |45j . control mixing processes [42], or model turbulent combustion 
[46] . In the last work [46], entropy is used in stochastic simulations as a convenient 
progress variable that allows for effective reduction of the chemical composition space 

Production of molecular entropy is the key factor in two general principles 
applicable to non-equilibrium dynamics: Prigogine's theorem of minimal entropy 
production [21] and Ziegler's maximal entropy production (MEP) principle [26] . 
Despite the apparent contradiction, these principles do not interfere with each 
other and both of the principles are consequences of Onsager's reciprocal relations. 



Mixing, entropy and competition 



9 



Prigogine's theorem is formulated for the specific conditions of a system asymptoticahy 
converging to steady (but not necessarily equilibrium) state where entropy production 
reaches its minimum while MEP is related to determining thermodynamic flows for 
given thermodynamic forces and at a fixed moment of time. According to a number 
of authors [3S1 [21] , MEP can also be viewed as a very general principle: if a nonlinear 
system has several routes of moving towards its equilibrium state, nature seems to 
prefer the route with maximal entropy production. For example, turbulent flow is a 
more likely state than laminar flow and the former has higher dissipation and higher 
entropy production. This MEP principle seems to be very plausible and general but it 
still needs qualifications of conditions and justification [IS]. Ozawa et al [H] analysed 
several different types of turbulent flows and concluded that MEP is applicable to these 
flows. The probabilities of positive and negative values of the entropy generation 
in non-equilibrium thermodynamics are connected by the fluctuation theorem |27) . 
which indicates that entropy increases are much more likely than entropy reductions. 
The variational principles of non-equilibrium thermodynamics have been previously 
reviewed in the literature |28| . 

The possibility of applying the entropy concept to macroscopic motions in 
turbulence and other similar processes (rather than to thermodynamic microstates) 
is the main interest of the present work. Pope [3D] suggested that in absence of 
any further information, the best way of approximating pdfs in turbulent flows is 
maximisation of entropy of the pdf constrained by available information about the pdf . 
Falkovich and Fouxon [33j analysed turbulence spectra with the use of entropy defined 
similar to the configurational entropy in the present work. Apparent thermodynamics 
is quite successful in specifying properties of inverse cascade in two-dimensional 
turbulence [571? ], since energy is preserved in this cascade and there is no vortex 
stretching in two dimensions. Dupree |31) analysed two-dimensional turbulence and 
introduced a definition of entropy which has two terms similar to configurational 
and state terms in equation ([6|. Three-dimensional turbulence, however, has proven 
to be more difficult and less susceptible to analysis based on the thermodynamic 
principles. Celani and Seminara [M] used DNS (direct numerical simulations) results 
to demonstrate that the statistics of turbulent scalar transport differs from the 
statistics expected in Gibbs equilibrium. Duplat and Villermaux [33] considered 
random stirring of a scalar field and found that it does not produce a field with 
maximal entropy. In all these works, fluctuations are treated as bringing additional 
chaos and entropy of these fluctuations is a positive quantity. Sancho and Llebot 
[22], however, suggest that the entropy associated with turbulent motion, which is 
more ordered as compared to highly chaotic molecular motion, is negative. This 
does not contradict the other publications since turbulent entropy is defined in Ref. 
[32] as the difference between the molecular entropy in a turbulent flow and that in 
a notional state of the flow after all turbulent fluctuations have been dissipated by 
viscosity. These examples illustrate that different quantities can be introduced as 
entropy and be very useful for analysis of non-equilibrium processes. However, when 
these quantities are different from the conventional molecular entropy, it is important 
to accurately define the quantity under consideration. In the present work, we use 
the term apparent entropy to distinguish entropy-like quantities from the molecular 
entropy. A similar distinction was drawn by Gray-Weale and Attard [3S] who use the 
terms "first entropy" and "second entropy" to distinguish the quantities analogous to 
the molecular and apparent entropies. Unlike molecular entropy, the apparent entropy 
is not necessarily controlled by the laws of thermodynamics (separately from molecular 
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entropy), and its properties require a special investigation. 

3. Entropy and mixing 

3.1. Entropy change by conservative mixing 

In this subsection we consider how entropy is changed by mixing as simulated by 
the major conventional mixing models. Mixing between particles can be preferential, 
when particle properties affect the selection of particles for mixing, or non-preferential. 
Although all mixing models we consider perform mixing between particles locally in 
physical space x, non-preferential mixing models do not discriminate particles on 
the basis of their properties y. In principle, preferential mixing allows for additional 
adjustment of mixing models to match better the physical mixing processes they 
simulate. Mixing preference can generally be expressed with the use of the mixing 
connectivity function < < 1 defined so that particles p and q can not mix if 
^pq — 0, particles p and q are most likely to be selected for mixing if 'i'pq — 1. The 
example problem is conventional homogeneous mixing of two initial states with y = 
and y = 1 occurring with equal probability into the final state oi y = 1/2. 

The models commonly used in combustion applications include lEM (Interactions 
by Exchange with the Mean, fSTl), the Curl's [ST and modified Curl's mixing models 
[MUSI, the EMST (EucHdean Minimal Spanning Tree) [S^ and the MMC (Multiple 
Mapping Conditioning) model [40l [41]. The two last models represent stochastic 
versions of Mapping Closure (MC) [56l and, for the problem considered here, would 
perform similar to MC. EMST introduces MC-type mixing through preferential mixing 
between particles. MMC exercises preferential mixing between particles but only in 
terms of the special reference variables that are added to the set of physical coordinates 
x; the selection of particles does not depend on y during MMC mixing. Mixing in the 
conventional Curl's model is non-preferential. 

Mixing affects both the configurational and state entropies. The change in 
configurational entropy is considered first. If the initial pdf /{y) has Delta-functions, 
the lEM and the old Curl's model do no produce smooth pdf distributions and are not 
suitable for this analysis. The mixing simulated by modified Curl's model and MP 
results in smooth distributions for which the configurational entropy is well defined. 
The Curl's model specifies mixing of particle p with another particle q by formula 

Vp = -^Vp + '^yi' (12) 

where the extent of mixing 77 is constant for the old Curl's model and random for the 
modified Curl's model. We use a uniform distribution of 77 on the interval [0, 1]. The 
calculated values of the configurational entropy versus a time-like variable 1 — a /uq 
where ct^ — {{y ~ {y)Y) and ctq = cr(io) are presented in Figure [l] There is a 
noticeable difference in entropies at the first stages of the mixing process that becomes 
small in the final stages of mixing despite the fact that MC-simulated pdf correctly 
approaches the Gaussian distribution while the pdf simulated by the modified curls 
model does not. The pdf simulated by MC is very close to the scalar pdf in real 
homogeneous turbulence |57j and so should be the configurational entropy term shown 
in Figure [1] 

We note that the configurational entropy can both increase and decrease in 
simulations. This, of course, does not contradict to the second law of thermodynamics 
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as the second component — the potential entropy — must be taken into account. For 
the case of ideal mixing the molecular entropy of mixing is defined by 

s{y) - {y ln(y) + {I - y) ln(l - y)) (13) 

where the constant is introduced to account for Boltzmann constant and scale 
different entropies consistently. The term s{y) enters equation ^ as the potential 
entropy Sf . We can show that this quantity always increases when simulated by 
any mixing model producing a non-negative approximation for the conditional scalar 
dissipation Ny — (^DiyyY\y) . Indeed the pdf scalar transport equation 

dfjy) ^ d'^Nyfjy) 
dt dy'^ 
results in the following expression for the entropy change 

considering the fact that (Ps/dy^ is negative for s{y) defined by ( [l3| . The integral is 
evaluated here by parts while taking into account that both Nyf{y) and its derivative 
tend to zero at the boundaries y = and y = 1 [H]. Figure |2] shows the curve s{y) 
and demonstrates that after both complete and incomplete mixing of two particles p 
and q the mean entropy of these particles (s(yp) + [yq))/2 increases. 

This example illustrates the following important point. The total entropy can 
be treated as the conventional thermodynamic entropy with the potential entropy 
Sf representing chaos of molecules completely mixed to molecular level and the 
configurational entropy Sc representing the chaos of turbulent fluctuations. In this 
case, however, the term Sf is proportional to the number of molecules and /3„ is so 
large that the term Sc is indistinguishable in the sum. The entropy S = Sc + Sf 
does, of course, satisfy the second law of thermodynamics. It can be very useful to 
consider the entropy of turbulent fluctuations but this quantity needs to be examined 
separately from the molecular entropy. 

3.2. Entropy change by competitive mixing 

Abstract competition studies the principles of competition in their most generic form 
|58| . The purpose of this representation may be seen to be similar to that of the 
Turing machine: making complex behaviours susceptible to general analysis but not 
specifically simulating any real devices or processes. Consider a complex system that 
has a large number of autonomous elements engaged in competition with each other. 
The evolution of a competitive system involves, in its general form, a process of 
determining a winner and a loser for competition between any two elements of the 
system. The properties of the loser are lost while the winner duplicates its properties 
into the resource previously occupied by the loser. The duplication process may involve 
random changes, which are customarily called mutations irrespective of the physical 
nature of the process. These mutations are predominantly negative or detrimental 
but can occasionally deliver a positive outcome. It is easy to see that abstract 
competition can be represented by a system of Pope particles, provided conventional 
conservative mixing is replaced by competitive mixing as discussed below. In context 
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of computations, the competing elements or any other notional autonomous objects 
are conventionally called particles without implying a reference to physical particles 
of any kind. In the present review "elements" and "particles" are used synonymously 
with "elements" primarily referring to competing components of general nature and 
"particles" to their computational implementations. 

Unlike conservative mixing, competitive mixing does not conserve the scalar 
values and gives a priority to the particle in a mixing group that is determined as 
the "winner" by duplicating its properties. The properties that belong to the loser are 
lost. The binary relationship "yp stronger than y,", or yp> Yq, means that particle 
p is the winner and particle q is the loser in competition of these particles. If yp is 
stronger than y^ (i.e. yp >- y^) then, by definition, y^ is weaker than yp (i.e. y^ -< yp). 
If Yp and y^ have the same strength then write yp ~ y^, while "^" implies "^" or 
"~" and implies ">-" or The outcome of competition is determined by the 

properties of the particles. Although more complicated schemes can be considered, 
competitive mixing is introduced here according to the following mixing rules [S] 

Yp -< yg,^pg = -1 (loser) 




yp^\ \, , yp-yq,Rpq^O (draw) , (15) 

Yp ^ Yg, Rpq = +1 (winner) 
where Rpq — ~Rqp is the antisymmetric competition index and ^ represents random 
mutations. Although this term is obviously borrowed from biology, mutations used 
here represent random redistribution of resources (i.e. particles) between different 
states and should not be confused with genetic mutations. In the case of a draw, the 
two possible outcomes are selected with equal probability. In principle, particles p 
and q can also be isolated from each other yp |j y^, which corresponds to 5'pq = 0; in 
this case Rpq does not need to be defined but still can be defined for these particles 
if convenient. Competition can be illustrated by the following reaction between the 
particles 

Yp + y-; + energy ->yp + yp, Yp ^ y, (16) 

where yp represents a mutated version of yp, yp is stronger than y^ and the word 
"energy" indicates existence of an external source of energy. 

The most simple example of competitive mixing is given by mixing of two states 
the losing state of ?/ = and the winning state of y = 1. The properties of this mixing 
were investigated by Klimenko and Pope [6 . This mixing can be considered as a model 
for turbulent premixed combustion as well as for evolutionary invasion processes such 
as invasion of more successful species into the area occupied by less successful species. 
The model follows findings of Pope and Anand 59 that when reactions are fast the 
pdf of the reaction progress variable is dominated by two states: unburned y = and 
burned y — 1. The governing equation for this model is related to the KPP-Fisher 
equation [501 EI] and to the BML (Bray-Moss-Libby) model for premixed turbulent 
combustion [62| . The equation is named after Fisher who introduced it first and after 
Kolmogorov, Petrovsky and Piskunov who investigated the mathematical properties 
of this class of equations. For this case, the entropy equation (|6| takes the form 

S = .1 {y)- { jy) In {{y)) + (1 - (y)) ln((l - (y))) , (17) 

where we put s(0) =0 and si = s(l) without loss of generality and (y) is the average 
value of y over the two states y — and y — 1. Although one may notice some 
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similarity with equation ( 13 ) , the physical meaning of that equation is different. As (y) 
increases due to mixing, configurational entropy Sc increases but then, as the winning 
state becomes more and more dominant in the distribution, decreases. For combustion 
waves, this correspond to converting reactants into the products and Sc = when the 
reactions are complete and only products are present. The products have a much 
higher value of entropy than the reactants (i.e. si ^ 1) and this ensures that the 
reactions are directed from reactants to the products. 

The existence of thermodynamics driving chemical reactions towards their 
equilibrium states is obvious. Since the same model based on Pope particles can 
be used to simulate invasions [S], there should be an apparent thermodynamics, which 
can characterise the invasion and be similar to the conventional thermodynamics 
of the chemical reactions mentioned above. While noting the similarities between 
reactions and invasions, we should not forget about the differences. Reactions in 
premixed combustion are directly driven by conventional thermodynamics towards 
maximal molecular entropy (or possibly minimal molecular Gibbs/Helmholtz free 
energy). In this case apparent thermodynamics is directly linked to conventional 
thermodynamics. Molecular entropy of successful species is not necessarily higher 
than (and the Gibbs/Helmholtz free energy is not necessarily lower than) that of 
unsuccessful species and the apparent and molecular quantities are not directly linked. 
Competitive systems in this case must receive exergy from outside to avoid the 
constraints imposed by conventional thermodynamics on isolated systems. Positive 
values of the apparent entropy potential si indicate the higher probability of presence 
of successful species in the equilibrium mixture irrespective of the physical reasons 
that ensure this success. While molecular thermodynamics explains the "success" 
of products over the reactants, it is not likely to offer a universal justification for 
the success of some competing elements over the others. Apparent thermodynamics 
recognises the obvious: nature has a greater affinity towards some states or competitive 
elements as compared to the other states or elements, irrespective whether we have an 
explanation for this affinity or not. Apparent thermodynamics is not fully reducible 
to molecular thermodynamics in the same way as molecular thermodynamics is not 
fully reducible to the laws of conventional and quantum mechanics. 

The invasion process is redistribution of the available resources in favor of the 
successful species. Mutations represent randomness in this process and may or may 
not be related to genetic mutations. The relativistic nature of the competitiveness 
should be stressed. Weaker species are perfectly stable and become weak only in 
presence of stronger species in the same way as reactants disappear only when their 
transformation into products is allowed. We now proceed further to introduce a special 
thermodynamics that can characterise competitive systems. 

4. Ordering, ranking and entropy 
4.I. Ranking in competitive systems 

Ranking of particles or elements in competition reflects how well a particle performs 
relative to the other particles. We distinguish the following rankings: 

(i) Two-particle ranking is the index function Rpq ~ R{yp,yq) that determines 



the winner and the loser in competition of p and q as shown in equation (15) 
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(ii) Absolute ranking is a function r^(yp) that determines the outcomes of the 
competition by 

r#(yp) < r#(y,) ^ yp =^ y, (18) 

that is r^(yp) < r^(yg) when and only when q is not a loser in competition 
with p. Introduction of absolute ranking requires transitivity and is subject to 
additional conditions as discussed in the following subsections. 

(iii) Relative ranking r(yp, [/]) is ranking of a particle y^ relative to a given 
distribution /(y) 

r{yp,[f]) = jR{yp,y')f{y')dy', (19) 

oo 

which indicates how competitive particle p is with respect to distribution /(y). 
The function — ^(y', [/]) can also be interpreted as ranking of distribution /(y) 
relative to the location y'. 

(iv) Co-ranking R{[fi], [/2]) is relative ranking of two distributions /i(y) and /2(y) 
defined by 

mhim^ j j R{y,y')h{y)f2{y')dydy' (20) 

oo 

and indicating competitive strength of these distributions with respect to each 
other. Note that co-ranking is anti-symmetric: R{[fi\^ [f2\) — —R{[f2\i [/i]) and 
^([/i]> [/i]) = 0. If i?([/i], [/2]) > 0, we_may write [/i] > [M and say that the 
distribution /i is stronger than /2 or, if [f2\) = 0, we may write [/i] ~ [f2\ 

and say that the both distributions have the same strength. 

In Appendix [B] these definitions are generalised for preferential mixing. The 
competitive binary relation, which is considered here, orders competing elements 
and is connected to their ranking. This and the example given in the previous 
subsection indicate the existence of a link between ranking and the entropy potential. 
For example, if the absolute ranking is introduced, then entropy potential s can 
be deemed to be a function of and higher ranking is expected to correspond 
to higher s. Higher ranking and higher entropy potential recognise a greater 
affinity of nature towards these states, while the physical reasons responsible for 
this affinity may differ. For example, more competitive states may correspond to 
higher molecular entropy or lower molecular Gibbs/Helmholtz free energy — in 
these cases the apparent and conventional thermodynamics are directly linked. More 
competitive states may also correspond to higher production rates of molecular entropy 
— apparent thermodynamics can reflect the MEP principle or, in fact, any other 
related variational principle. Following the traditions of classical thermodynamics, 
we generally leave the exact physical mechanism of competitiveness of the elements 
outside our consideration but accept that some states are more competitive than others 
and proceed to investigate the consequences. Competitive systems are, of course, 
compliant with molecular thermodynamics but, at the same time, they represent 
open systems and the apparent quantity s is not necessarily linked to the molecular 
entropy or Gibbs/Helmholtz free energy. The connection between ordering, ranking 
and entropy has, as reviewed below, cross-disciplinary significance. This connection 
is further explored in the following sections, where we draw an important distinction 
between transitive and intransitive competitions. 
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4-2. Ranking and fitness 

The concept of fitness has similarities with competitive ranking, although these 
concepts have differences. Ranking differs from fitness in the same way that 
competition differs from criteria-based selection. A high-ranking particle can perform 
poorly when even higher ranking competitors are present while a low-ranking particle 
may survive if it does not have to compete against particles with higher ranks. 
Traditional fitness reflects adaptation to the environment and has an absolute value, 
which typically indicates the percentage of surviving offspring, while ranking reflects 
a direct competition between elements and is inherently relativistic. If the differences 
between adaptation and competition are overlooked and fitness is defined as a general 
indicator of the overall ability to survive, the absolute ranking (provided, of course, 
the absolute ranking exists) can be identified with fitness. 

We should mention Eigen's quasispecies models which can also duplicate 
and mutate elements. The essence of the current approach is the direct competition 
between the elements comprising the system while the elements of the Eigen model 
do not compete directly against each other but utilise a common restricted resource 
with efficiency determined by the fitness of the elements. The behaviour of competing 
elements changes dramatically depending on which competitors are currently present. 



while the relationships between different elements expressed by (151 can be very 
complex. Competition makes a very sharp judgment: a loss by a small margin is 
still a loss. As in the Eigen model, the competition may be powered by an external 
source of exergy but, otherwise, the abstract competition, which we consider here, is 
much more similar to conventional mixing than to self-replication taking place in the 
Eigen model. 



4-3. Ranking and adiabatic accessibility 

A number of publications [641 - 167] has been dedicated to the goal of constructing 
thermodynamics based on the principle of adiabatic accessibility [1] . A notable success 
has been achieved by Lieb and Yngvason 3J, who reviewed the previous attempts 
and demonstrated that this goal can be achieved in a rigorous and unambiguous 
mannei[|] A popular presentation of these results is given by Thess [HS]. Adiabatic 
accessibility is a binary relationship that indicates the possibility or impossibility of 
reaching one state from the other by a reversible or irreversible adiabatic process. 
This binary relation and the rest of conventional thermodynamics are fundamentally 
transitive. Adiabatic accessibility is required to comply with a number of axioms 
including transitivity and allows for the introduction of empirical entropy that remains 
the same in reversible processes and increases in irreversible processes [66j . Empirical 
entropy is not unique: any strictly monotonic continuous function of the empirical 
entropy is its equivalent. One of these functions, however, is thermodynamically 
extensive and represents the thermodynamic entropy. If we use the current notations, 
then Yp =4 Yq indicates that the state is adiabatically accessible from the state yp 
by a reversible adiabatic process when yp ~ or by an irreversible adiabatic process 
when Yp -< yg. The empirical entropy is analogous to absolute ranking ^^(y) while 
s is related to thermodynamic entropy. The function s = s{r^) is monotonic and 
represents equivalent ranking but s is also constrained by the properties of mutations. 

f A similar approach, albeit based on a different quantity - adiabatic availability, has been previously 
developed by Gyftopoulos and Beretta |85l 
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The analogy with adiabatic accessibihty is transparent. 



4.4- Ranking and economic utility 

The introduction of an absolute ranking for transitive ordering is subject to conditions 
of the Debrcu theorem [SU] (see Appendix |A]) , which was originally formulated in 
context of economic science, where absolute ranking of consumer preferences has been 
repeatedly studied under the name of "utility" (see review by Mehta [70]). Utility 
specifies the competitive property of some goods and services to satisfy the needs of 
consumers as compared to that of other goods and services. 

It is most useful to learn that similar methods have been under development in 
theoretical physics and mathematical economics for more than half a century without 
any knowledge or interaction between these fields. The similarity between introducing 
economic utility and physical entropy was noticed first by Candeal et. al. [71j , who 
called the similarity "astonishing". While Candeal et. al. |7l] proceeded further to 
compare the formal conditions of the main theorems, the principal question of the 
physical reasons behind this similarity remained unanswered. If abstract competition 
is relevant to both thermodynamical entropy and consumer utility, this may serve as 
the missing physical link between the fields. Although abstract competition is a generic 
framework, which is not intended to simulate any specific economic conditions, the 
following consideration indicates that, indeed, consumer behaviour might be related 
to abstract competition and there probably should be a kind of economic entropy 
associated with utility. 

The traditional economic consumer has to solve a conditional extremum problem 
while going shopping — the problem of maximising the utility of his consumption 
bundle under given budgetary constraints. A less mathematically savvy consumer, 
who behaves according to the competition principles considered here, simply compares 
his existing bundle with another offered bundle and, if he likes yp more than 
Yq (i.e. Yp >- yq), keeps the existing bundle y^. The consumer, however, can like the 
new offering more than the old one (i.e. y^ >- y^), then in this case is replaced by 
Yq. Economists may say that the consumer reveals his preference of y^ over yp. The 
analogy can be extended to involve mutations: if y^ >- yp, the consumer may not get 
exactly what he/she wants or expects (i.e. y^ — one may recall inaccurate advertising 
or incomplete information about the products) but a modified version of the bundle 
Yp = Yg + ^. It is most likely that the consumer would not like these modifications 
Yq + C ^ Yq as, indeed, the mutations tend to be predominantly negative. 



5. Thermodynamics of transitive competition 

Competition is deemed transitive when for any selected particles p, q and r, 

Yp ^ Yq andy, 4 Yr ^ Yp 4 Yr (21) 

that is the relations yp ^ y^ and y^ ^ y^ demand that yp =<; y,.. Transitive binary 
relationships of this kind can be referred to as order or a preorder. Subject to the 
conditions of the Debreu theorem |69| , transitive competition allows for introduction 



of the absolute ranking r# = r#(y) defined by (18 1. 

The absolute ranking is related to the entropy potential: higher ranking of y^ 
corresponds to higher probability of this state and consequently to higher entropy 
potential s{r^(Yp))- In the example of premixcd combustion model of the previous 
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section, the absolute ranking can be selected so that the states of y — and y — 1 
correspond to = and — 1 respectively, so that higher rank corresponds to 
a stronger particle. If mixing is non-preferential, it is sufficient to consider a single 
property r^(y) that can be simply denoted by y. It should be noted that absolute 
ranking is not unique and any monotonically increasing function of represents an 
equivalent ranking. Similarities with existing approaches are explored in the following 
subsections. 



5.1. Gibbs mutations 

If mixing is non-preferential and the competition is transitive, the outcomes of the 
competition are determined only by the absolute ranking r^{y). For the sake of 
simplicity, we can assume that y is a scalar denoted by y since, otherwise, we can 
simply select ranking as y. Knowledge of yp and is sufficient to determine the 
winner in competition between particles p and q. We imply that higher values of y 
correspond to higher ranking, hence yi =4 2/2 is the same as yi < 2/2- 

Thermodynamic relations become most transparent for a certain class of 
mutations that satisfy some Markovian restrictions and are named Gibbs mutations. 
As discussed in Appendix [C] we broadly follow the ideas of introducing 
thermodynamically consistent Gibbs measures for Markov fields and graphs . Gibbs 
mutations are non-positive and for the case considered here take the form 

f hiv) < o 

/c(y,y°)- ^"l,^")' , (22) 

[ 0, y>y 

where ^o(y°) is the normalisation constant depending on y° and /o(y) is the 
equilibrium distribution (that is according to the H-theorem[lj the distributions f{y) 



converges to the same function fo{y) that is used in the definition of J,^. Equation (22 ) 



(541 



is consistent with ( 52 ) and also with a more general definition of Gibbs mutations by 



Absolute ranking is generally not unique since any monotonically increasing 
function of represents an equivalent ranking. We relate absolute ranking to entropy 
s = s(r^) potential and can use this entropy for ranking purposes. The equation 
/o ~ exp(s) links s to the mutation intensity and makes this entropy-related definition 
of ranking unique. The a priori statistical weight A(y) can account for different phase 
volumes of different states and in many cases can formally be set to unity without 
affecting the evolution of the system. However, the physical interpretation of A{y) 
can be linked to the probability of particle distribution under conditions when the 
competition is switched off. We should note that the exponential form for distribution 
of mutations was previously suggested and used in genetic theory [72] , although we do 
not have any specific intention here to match the properties of genetic mutations and 
are interested in a general consideration of competing systems. Theorem [l| which is 
proved in Appendix |D] and represents the principal step for introducing competitive 
thermodynamics, is a competitive analog of the Boltzmann H-theorem. According to 
this theorem, the entropy S monotonically increases until it reaches its maximal value 
and at this point the distribution f{y) reaches its equilibrium fo{y). The particle with 
the highest rank — the leading particle, which denoted here by — remains at the 
same location since it can not lose competition to a lower-ranker and at the same time 
can not be overtaken by another particle due to absence of positive mutations. 
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The H-theorem also indicates that a detailed equilibrium is reached in the 
equilibrium state. In this state the overall entropy is maximal and, if the system is 
divided into subsystems, say / and J (see Appendix [B|), their competitive potentials 
must be the same Xi — Xji otherwise the entropy can be increased by transferring 
particles from the subsystem with lower x to the subsystem with higher x (note that 
according to equation (10 1 Xi = ^^{Zi/aj) — 1 for any I ). Due to the detailed 
balance in equilibrium, the competitive connection between any two locations, say 
yi and 2/2 j can be severed without affecting the equilibrium state (terminating both 
the competition and the exchange by mutations) as long as these locations remain 
connected through other locations. Competitive systems with Gibbs mutations are 
thus most stable and stability is an important factor constraining the existence of any 
realistic system. 



5.2. Infrequently positive near- Gibbs mutations 

The existence of positive mutations is an important factor affecting the evolution of 
competitive systems which can not be overlooked or neglected even if these mutations 
are small and infrequent. Positive mutations are deemed to be relatively rare and 
negative mutations remain dominant. The absolute ranking r^ — r^{y^) of the 
leading particle still can not decrease but can increase as there is a small but still 
positive probability of mutations that result in a particle overtaking the leader and 
becoming the leading particle. The state with distribution fo{y,y*) and a fixed y^ 
should be referred to as a quasi- equilibrium state since the distribution may shift 
towards higher ranks whenever the leading particle is overtaken. The leading particle 
y^ is occasionally overtaken by another particle y^ due to a positive mutation in the 
leading group so that — r^ijj'^) > r* = r^(?;*). The distribution function remains 
almost without change f(){y,y*) but it is now different from the new equilibrium 
distribution /o(y,2/*)- According to the H-theorem, f{){y,y*) should evolve towards 
foiyiV'*) as entropy increases. The current system can be treated as a combination 
of two subsystems with the domains J)* and corresponding to the intervals 
{y) ^ T* and < r^ (y) < r^ . The particles move between the subsystems towards 
higher values of competitive potential x, that is from "D^ to Sa until the equilibrium 
between the subsystems is reached. The overall distribution shifts from /o(2/, y*) into 
the more competitive state of fo{y, yl). 

The behaviour of competitive systems with infrequently positive mutations is still 
consistent with the introduced thermodynamics and results in increasing total entropy 
S{t) and competitive potential Xo(^)- Equilibration from arbitrary initial conditions 
occurs in two steps: rapid relaxation into quasi-equilibrium /o(y, y*) with fixed 
and 2) gradual increase of the system ranking r^,(t) — r^{y^,{t)) in time. The second 
process is, rigorously, still not at equilibrium but as long as the probability and the 
magnitude of positive mutations are small, the current distribution / remains close 
to the equilibrium distribution fo{y,y*{t)) that depends on the currently attained 
ranking r.^,{t) of the leading particle y*(t). Hence, / is given by equation ([t]) with 

A{y,y,{t)) = A„{y)H{y,{t)-y), (23) 

where H is the Heaviside function and the partition function ([s]) becomes time- 
dependent 

Z{t)= r^'\oiy)exp{.siy))dy, (24) 

J —00 
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Competition resulting in gradual overall increase in absolute ranking and in 
competitive potential Xoit) — — 1 is called competitive escalation. If and 

when the leader reaches its maximal possible rank, the system enters the state of 
global equilibrium, which can be altered only by external forces. 

5.3. General infrequently positive mutations 

Although Gibbs mutations represent a reasonable and general approximation for the 
randomness present in competitions, mutations may deviate from this approximation. 
For example, this may happen if the accessible space becomes dependent on the 
location of the leading particle. In terms of the a priori statistical weight this can 
be expressed as A = A(y,y^). The competition considered in this subsection is 
transitive with absolute ranking r#(y). If the competition is transitive and the 
position of the leading particle is fixed, the process according to the second convergence 
theorem presented in Appendix [D] still converges to its equilibrium state /o with 
maximal entropy S although convergence is not necessarily monotonic and the detailed 
balance is not necessarily achieved in the steady state. The shape of the equilibrium 
distribution is dependent on the position of the leading particle. 

The position of the leading particle either remains fixed if the mutations are 
non-positive (and no particle can overtake or challenge the leader), or the leading 
particle y*(i) escalates towards higher ranks: dr^{y^{t))/dt > if mutations are 
infrequently positive. Small and infrequent positive mutations should not affect a 
distribution that remains close to the equilibrium / w /o(y,y*(i)). If the parameters 
of the competition do not change with y.^ the shape of the function remains the same 
/ ~ /o(y ^ y*('^)) while location of the function shifts towards higher ranks. Hence, 
the behaviour considered here is very similar to the case with near-Gibbs mutations: 
rapid relaxation of the distribution into a quasi-equilibrium state /o(y,y*) and then 
a gradual escalation of the distribution towards higher ranks. 

Overall, a competitive system with general infrequently positive mutations and 
transitive competition behaves qualitatively similarly to the case of Gibbs mutations, 
but the analogy with conventional thermodynamics weakens. 

5.4- Competition and principles of non- equilibrium thermodynamics 

The trend of moving towards higher ranking is consistent with the introduced 
competitive thermodynamics since the total entropy increases in this process. 
Although Prigogine's theorem of minimal entropy production |24| is generally not 
applicable to this process, we note that the behavior of the system with infrequently 
positive mutations is qualitatively consistent with the theorem. Indeed, if the initial 
distribution f{yi,y*) is far from equilibrium, the system rapidly approaches the 
equilibrium distribution foiviiV*) and the entropy production significantly decreases 
as the distribution becomes close to /o(yi,2/*)- If positive mutations are present in 
the system, then the entropy production continues at a small rate as the distribution 
gradually moves towards larger values of r^ and s. Application of the MEP principle 
to complex systems can be subject to different interpretations [2H1 [53 US]. One of 
the possibilities is applying MEP to apparent entropy. We may expect that nature 
favours quasi-steady processes with the fastest possible rate of increase (or minimal 
rate of decrease) of competitiveness (and, consequently the apparent entropy) among 
all possibilities available to the system. This seems plausible as the systems achieving 
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the most competitive states are expected to be the winners in the competition. The 
possibihty of applying MEP to the rate of production of the molecular entropy is not 
clear as self-organisation, which is present in competitive systems and discussed in the 
following sections, tends to reduce the intensity of competition and, as a result, reduce 
the production rate of conventional entropy (while increase in numbers of successful 
species should indeed increase consumption of the resources and the molecular entropy 
production) . 

In our consideration, information has eternal properties: once some combination 
of particle properties is achieved, it can exist forever unless destroyed in competition. 
We may also consider the case when particles have a finite life span, as quasispecies 
have in the Eigen model [63]. The particles are to be terminated (and regenerated 
with random properties) with some small probability after a lengthy characteristic 
time Te, which we may call the erosion time as this process is likely to be associated 
with increase in molecular entropy. In this case, the leading particle may eventually 
disappear resulting in a weak drift towards lower ranks. The presence of some 
randomness in determining the winner and the loser would have a similar effect. 

The mutations considered here are predominantly negative. The physical reason 
behind the rarity of positive mutations is not an inherent propensity of the mutations 
for weakness: the mutations are random and do not have any "purpose", positive 
or negative. Mutations, however, tend to be negative since there are many more 
effective micro-states T{y) at the lower ranks than at the higher ranks. Hence, a 
purely random mutation is much more likely to step down than to step up in ranks. 
Here, we consider scalar y for the sake of simplicity although the consideration is 
also suitable for vector states y. It is possible to introduce the a priori entropy s(y), 
which is linked to the number of micro-states at given state y and defined by the 
Boltzmann relation s{y) = ln(r(j/)). Here, r(y) represents a priori probability, which 
is the nominal steady-state probability distribution in absence of competition. As 
previously noted, A{y) can be justifiably identified with r(y) but A{y) also may be 
selected in different ways without loss of generality. For presentation of results in this 
section, it is convenient to simply put A{y) ~ 1. 

Although the entropy s may often be implied while referring to the entropy 
of evolutionary systems, the a priori entropy s is different from and should not be 
confused with the entropy potential s. The entropy potential is related to competition 
and is larger at higher ranks while s is not related to competition and is larger at 
lower ranks. Although s does not enter the definition (|6|, the effect of the a priori 
entropy is present in competitive thermodynamics. First we note that there is an 
equilibrium distribution fo{y) ~ exp(s(?/)), which generally should be approached 
when competition is switched off. In fact fo can not be approached in most cases 
due to the enormous capacity of F; hence / has to stay far from the equilibrium /q. 
The a priori entropy, however, still influences competition through non-equilibrium 
mechanisms as expressed by the fluctuation theorem [27] . Appendix [C] demonstrates 
that relative frequency of positive mutations is constrained by the fluctuation theorem 
so that 




ds 



(25) 



Assuming that /3 > and C > 0, one can note that the distribution has a steeper 
exponent on the positive side so that large /3 enforces infrequency of the positive 
mutations. The absence of positive mutations corresponds to infinitely large /3. Note 
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that the condition /3 ^ 1 limits the possible range of y by physical restrictions imposed 

on r. 



5. 5. Numerical simulations of competitive escalation 



In the special case oi A — 1 and linear dependence of s on y, that is s ~ f3y + const, 
the distributions of mutations become exponential. The value of /3 may be seen 
as resembling conventional inverse temperature, being inversely proportional to the 
intensity of fluctuations. Equations ([7|, ([22]) and (251 yield a double-exponential 
distribution 



/c(y,y°) = 



6oexp(6i(t/-y°)), y < y° 
boexp{b2{y° -yj), y>y° 

where 6o is determined by the normalisation condition 
11 1 
6o bi &2 

and 

ds 



6i=/3=— , 62 = &!+/?, /3 = - 
dy 



ds 
dy 



(26) 



(27) 



(28) 



(29) 



Note that both values /? and (3 are positive. Another distribution, which is used in 
simulations presented here, is the shifted exponential distribution given by 

" 6iexp(6i(y-y°-Co)), y < y° + Co 

0, y > y° + Co 

Here, a small value Co — accounts for rare positive mutations. Without loss of 
generality, one may put &i = 1 and y = s. 

The mutations are non-positive when 62 = 00 in ( 26 ) or Cq = in ( 29 1 . The 
mutations, however, become infrequently positive when 62 is large or C^q is small. The 
exact analytical solution /o — exp(y— y*) for non-positive mutations is shown in Figure 
[3] by the solid line. The other lines show the distribution /(y,y*) for the process 
of competitive escalation with 4% of positive mutations (i.e. I/62 = Co = 0.04). 
The simulations are performed with 1000000 Pope particles. Mutations (26) and 



(29) correspond to the dashed and dotted lines. The formula determining the rate of 
competitive escalation, which was derived in Ref. [5,, can be written as 



dy* 
dt 



Co_ 

At 



At 



(30) 



where H is the Heaviside function, Ai is the time step and cq is a constant depending 
on the distribution of mutations. The approximate evaluation of dy^jdt is performed 
in (30) for 62 3> b\ in the double-exponential distribution (26), indicating that the 
effective selection rate of the competition process is given by ds^,/dt ^ — The 
constant is co ~ 5.4 for (26), cq k, 3.2 for (29) and co ~ 3.7 for the uniform distribution 
of mutations considered in Ref. [5j . 
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6. Thermodynamics of intransitive competition. 

Competition is intransitive if at least one intransitive triplet 

Yp 4 Yq 4 Yr ^ Yp (31) 

exists in the system. Generally, a consistent absolute ranking can not be introduced 
for intransitive competition, but ranking can often be assigned to subdomains if the 
competition is transitive within these subdomains. It should be noted, however, 
that the rankings assigned in different subdomains would result in multi-valued 
functions and can not be made fully consistent with each other when the competition 
is intransitive (see the example in Figure |5|. Relative rankings are valid for all 
competitive systems irrespective of their transitivity. The problem of introducing 
ranking in intransitive tournaments has been treated in a number of relatively recent 



publications [73l [74]. Our choice of ranking specified by (18)-(20) is based on 
consistency with the evolution induced by competitive mixing. The term "ordering" 
conventionally refers to transitive orders while intransitive binary relationships may 
be called "preferences" or "tournaments". The term "tournament" seems to have 
become common in recent publications 75 , unfortunately, this term is likely to be 
confusing in the context of the present work. 



6.1. Intransitivity and its physical reasons 

Although the fact that intransitivity may appear as the result of superimposing several 
perfectly transitive rules has been known since the days of French revolution as 
the Condorcet paradox (this paradox was noted first by outstanding mathematician, 
philosopher and humanist marquis de Condorcet [3), intransitivities were viewed for a 
long time as something illogical or undesirable [THj. For example, if someone prefers A 
to B, B to C and C to A, can we see this individual as behaving reasonably? According 
to the famous Arrow theorem [77^ , the problem of intransitivity may pose a problem to 
choice in democratic elections. McGarvev|78j proved that any intransitive preferences 
on a finite set can be represented as a majority superposition of a finite number of 
transitive orders. Intransitivities have become more philosophically accepted in recent 
times [7S] and are now commonly used in physics 80 , biology [5T] as well as in social 
and economic studies [751 - F75] . 

Conventional thermodynamics is fundamentally transitive and the thermodynam- 
ics of transitive competition is similar to conventional thermodynamics in this impor- 
tant respect. We cannot expect competitiveness to increase indefinitely, as it is likely 
to have some physical constraints even if an external source of exergy exempts the 
system from being isolated and subject to the immediate constraints of conventional 
thermodynamics. As shown in the previous section, if the leading element of the dis- 
tribution reaches the point of maximal possible rank in transitive competition, any 
further development in the system is terminated. In conventional thermodynamics, 
this point is represented by the global equilibrium with maximal entropy or minimal 
Gibbs/Helmholtz free energy. The highly competitive group with maximal ranking 
would prevent any alternatives from a successful challenge; the system then stops 
evolving any further. One may hope that once a transitive equilibrium is reached, the 
creative hand of nature changes external conditions in a "right" direction so that the 
complex development may resume. Unless the complexity of this intervention is at 
least comparable with the complexity of the evolving systems, the long-term efficacy 
of such intervention seems doubtful. In most cases stable systems only slightly alter 
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their states to attain a new equilibrium and compensate for the environmental dis- 
turbance. It seems that transitive description is an oversimplification of the complex 
(and often cyclic) behaviours observed in realistic competitive systems. Transitivity of 
competitive thermodynamics is not guaranteed a priori and depends on transitivity of 
the competition rules. Multiplicity of competitiveness criteria combined with a rather 
limited number of outcomes (i.e. winner or loser) is most likely to produce intransi- 
tivities due to the same reasons that were first discovered in the Condorcet paradox. 
Systems with intransitive competition rules must have an external source of exergy 
or negentropy [52], since isolated systems are subject to the constraints of conven- 
tional thermodynamics and must be transitive. Complex behaviour is known to occur 
far from equilibrium of conventional thermodynamics [1], since Onsager's reciprocal 
relations do not allow for cycles and enforce transitivity close to the equilibrium. 

6. 2. Types of intransitivity 

Any intransitive relation has its transitive closure — another relation that is transitive 
and is, as much as possible, close to the original relation (see Appendix [A| for details). 
We denote the transitive closure of our original competition rules by "^t" , 'Vt" and 
It is useful to distinguish the following possibilities. 

(i) By transitive closure: 

(a) Completely intransitive competition: all elements are transitively 
equivalent, i.e. yp ~t for any p and q. In terms of the original relation, 
any two elements p and q are a part of at least one intransitive loop 

Yp 4yi 4 y2-- 4yq 4 yi y2--- Yp (32) 

(b) Intransitive competition having a transitive component: the 

transitive closure involves several transitively unequal classes. In this case, 
yp^iVq requires yp ^ y,. 

(ii) By localisation: 

(a) Locally intransitive competition: intransitive triplets can be found in 
the vicinity of any point 

(b) Intransitive competition with local transitivity: the domain of 
properties can be divided into subdomains so that the competition is 
transitive within each subdomain (but not in the whole domain) 

If competition has a transitive component, an absolute ranking corresponding 
to this component can be introduced. This ranking, however, would be the same for 
all elements from the same transitive class, i.e. rt{yp) = rt{yq) for yp ~f y^ while 
it might be the case that yp >- y^ or yp -< y^. If competition is locally transitive, 
rankings can be introduced for each transitive subdomain but can not be consistently 
extended to the whole domain. In general, a complex competition may involve a 
sophisticated hierarchy of transitive and intransitive rules. For example, intransitive 
competition may have a locally transitive component or intransitive competition may 
be locally transitive and have a transitive component, etc. 

Intransitivities may be also distinguished by their origin. A common source of 
intransitivity is superimposition of perfectly transitive rules. For example, comparison 
of subsystems by co-ranking (that is [fp] =4. [/b] when .R([/a], [/b]) ^ 0) can exhibit 
intransitive properties even if the underlined competition between particles is strictly 
transitive. This can be interpreted as a variation of the Condorcet paradox[7]. The 
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example of three distributions of particles /a, /b and Jq such that [/a] -< [/b] ^ 
[/c] ^ [/a] is shown in Figure [4] We may interpret the sybsystems as competing 
super-elements but should expect that the rules for this competition are intransitive 
irrespective of the transitivity of the original competition rules. 



6.3. Gibbs mutations in intransitive systems. 

If mutations are restricted to Gibbs mutations, only one equilibrium distribution 
/o(y) is possible in the case of complete intransitivity since mutations defined by 



equation ( 54 1 propagate to the whole of the domain through the chain ( 32 1 . Different 
equilibriums, however, are possible when the competition has a transitive component. 
Since the component ordering denoted by is transitive, an absolute ranking can 
be introduced so that rt{yp) < rt{'yq) is equivalent to =^t y^. If intransitive 
competition has a transitive component, the system behaves with respect to this 
component as discussed in the previous section. The equilibrium distributions can 
be written as /o(y, T.^,) where is the ranking of the leading class and r^ may increase 
if some positive mutations are present in the system. The H-theorem (Theorem [T]) 
apply to Gibbs mutations irrespective of the transitivity of the competition. 



6.4. Current or local transitivity 

Distribution of a finite number of particles may be confined to a much smaller region 
(we can call it current region) as compared to the region of strict positiveness / > 
of the function /(y): particles can not be found in the region where /(y) is formally 
positive but very small. Competition in the current region may be transitive while 
remaining intransitive in larger regions. We can characterise this situation as currently 
transitive distribution. Currently transitive distributions behave over short period 
of time as if the competition is transitive. This case is illustrated in Figure [5] 
The competition shown in this figure is completely intransitive and an equilibrium 
distribution spreads over the whole domain. If the system is invariant with respect 
to shifts along the circle, this equilibrium distribution must be uniform. There is, 
however, another possibility when the number of particles is limited: the equilibrium 
distribution of particles can be confined to a narrow segment of the circle since / in 
the rest of the domain is too small to be taken into account. If some rare positive 
mutations are present in the system, this distribution will keep cycling around the 
circle indefinitely. In this example, the competition is completely intransitive but 
currently transitive. 



6.5. General mutations in intransitive systems. 

In transitive competition, systems with general mutations behave in a qualitatively 
similar way as compared to systems with Gibbs mutations. This is not necessarily 
the case when competition is intransitive. In the absence of mutations, all non-trivial 
stationary distributions tend to produce oscillations (unless Rpq = for all non- 
isolated p and q — see Appendix |d]). Instabilities can also be expected in intransitive 
systems if the level of mutations is insufficient. Although there is a large diversity 
of possibilities in intransitive competitions, the behaviour of the systems may be 
predicted when certain restrictions apply. Intransitivity may be weak and dominated 
by transitive relations. If competition is intransitive but has a transitive component, 
the system would behave with respect to this component in a way that is similar to 
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the case of general mutations in transitive systems. The ranking associated with the 
transitive component can stay constant or increase in time. A similar behaviour can 
be expected for competition that is currently transitive. The distribution evolves as if 
the competition is transitive over a short period of time but the system may appear 
to be cyclic over longer periods as illustrated in Figure [5] Absolute ranking can be 
introduced within a sector of the circles in Figure [5] but not over the whole domain. 
Cyclic behaviour is common for intransitive competition: at any given moment the 
system seems to progress forward but after the cycle is completed, it finds itself in the 
original state. Changes that seem to be improvements at a given time may prove to 
be detrimental in the long run. 

Although intransitive competition does not guarantee a global improvement in 
competitiveness of a system, we still may expect some degree of local consistency 
with competitive thermodynamics. Since there is generally no absolute ranking in 
intransitive competition, we can use a relative ranking measured with respect to 
current distribution = fiyX) that is r°(y) = r(y, [r]) and = [/"]). 

The distribution f° remains fixed and, as f{y,t) evolves, / becomes more and more 
different from f°. We, however, consider a short-term development of /, when / stays 
close to /°. According to the evolution equation (78), the competition step Sfc always 
improves current ranking R°{[6fc]) > 0, but tends to decrease the configurational 
entropy Sc- The following mutation step Sfm tend to decrease ranking R°{[6fm]) < 
0, since most of the mutations are non-positive and increase the configurational entropy 
Sc, since mutations are random. In a steady case f — fo all these changes compensate 
each other and entropy defined by equation ^ reaches its maximum. It is possible, 
however, to have a nearly steady state which is stable but continues to evolve slowly, 
that is fo = fo{y,y°) where y° is the /"-graded leading particle (the particle from the 
distribution / with the maximal ranking r° = r(y°, [f°]) ). In many cases r° — r°{t) 
tends to increase in time and conditions sufficient to ensure this can be nominated 
(for example possessing a current transitivity or a transitive component). It seems, 
however, that cases of decreasing r°{t) are also possible in some circumstances: we 
call these cases competitive degradations. There are indications (Section 7.4) that 
degradations are accompanied by an increase in chaotic behaviour and it may be the 
case that properly defined overall entropy still increases, although there is no certainty. 
Competitive degradations, which are competition failures, should be distinguished 
from erosive degradations, which are induced by physical inabilities of the system to 
retain information as needed or by partial suppression of the competition. 

The intransitive competition process is blind and can not guarantee long term 
absolute increase in rankings. Ranking in intransitive competition becomes relative: 
what seems to be a competitive improvement now may later appear to be a loss 
of competitiveness. It is natural, however, that competition improves the current 
relative ranking ^°([/]) — R{[,f], [/°]). The example shown in Figure [H] illustrates the 
case when the current ranking ^°([/]) increases as the distribution /(y,y°(i)) moves 
counterclockwise. This distribution, however, may lose its stability and collapse due 
to disturbances located at point A, since ranking of the distribution with respect to 
point A decreases as y°{t) gets closer to A. Hence, dechne and collapse may be caused 
by both of the factors mentioned above: direct competitive degradations accompanied 
by reduction of R°{[f]) and by short-term escalation of ranking R°{[f]) that appears 
to be detrimental to the stability of the distribution over a long run. 
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7. Examples of different behaviours observed in competitive systems 

Without implying that competitive behaviour must be limited to the modes listed 
below, we distinguish the following types of behaviour in realistic systems: 

(i) Stable equilibrium. A competitive system remains in this state indefinitely 
unless surrounding conditions are changed. 

(ii) Competitive escalation. A competitive system reaches a quasi-equilibrium 
state and continues to slowly evolve in the direction of increasing competitiveness 

(iii) Invasion wave is a rapid escalation occurring in a propagating wave. This 
process is inhomogeneous. 

(iv) * Regular cycle. Competitive escalation with respect to the current distribution 
results in recurrence of the same conditions due to cyclic intransitivity. 

(v) * Competitive cooperation and self-organisation. Under certain conditions 
when competition is intransitive and localised in physical space, the elements 
tend to form cooperative structures (with a reduced level of competition within 
the structure) and collectively struggle for domination over other structures. 

(vi) * Competitive degradation. A system reaches a quasi-equilibrium state which 
slowly loses its competitiveness. 

(vii) * Leaping cycle. A structure quickly rises to dominance, holds a dominant 
position and then weakens due to competitive degradation or loss of stability and 
rapidly collapses. If the competition has a transitive component, each subsequent 
cycle should be somewhat different from the previous one, so that the evolution 
of the system resembles a spiral. 

(viii) * Unstable and/or stochastic behaviour. A system does not have a stable 
equilibrium (or c^uasi-equilibrium) and possibly evolves in an irregular manner. 

The types of behaviour marked by the asterisk can be observed only in intransitive 
systems. An example of a stable equilibrium is given by non-negative mutations 
in transitive competition. Competitive escalation is related to positive mutations, 
whose effect is shown in Figure [Sj Turbulent premixed flames give an example 
of invasion waves Pj. Competitive cooperation, self-organisation and competitive 
degradation have been detected to occur in intransitive systems with localisation 
of mixing in physical space While transitive behaviour is more consistent 

with conventional thermodynamics, which is constrained by its zeroth law and is 
fundamentally transitive, complex behaviour in competitive systems is associated with 
intransitivity. Examples of intransitive competitions are considered below. 

7.1. Turbulent flows 

Turbulence is a complex phenomenon which can provide examples of intransitive 
behaviouif§l One of the possible examples of turbulent intransitivities is illustrated 
in Figure |6j which shows the routes for kinetic energy exchange between different 
Reynolds stresses in a turbulent shear flow|13). Energy is supplied from the mean 
shear and dissipated at the smallest scales. This supply/dissipation process, however, 

§ As demonstrated by van Heijst et. al. |86l . two-dimensional turbulence can display complex self- 
organising (and likely intransitive) behaviour, which appears to be very similar to behaviour described 
for complex competitive systems in Section 7.4 
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is not uniform: competition for energy between different Reynolds stresses occurs in 
an intransitive manner as shown in Figure[6j In general, the cyclic nature of the energy 
exchange shown in the figure may produce oscillations during rapid distortions but 
it seems that dissipation, which is strong in turbulent flows, tends to dampen these 
oscillations in most cases. 

7.2. Belousov-Zhahotinsky reaction 

Intransitivities are possible in chemical reactions. The Belousov-Zhabotinsky reaction 
is known to display a cyclic chemical behavior in a homogeneous mixture, which is 
unusual since most chemical kinetics tend to monotonically converge to an equilibrium 
or steady state. If the reactants denoted by A and B are supplied to the system and the 
product P is removed from the system, the oscillations of concentrations can continue 
indefinitely. The simplest chemical kinetic scheme that can adequately simulate the 
Belousov-Zhabotinsky reaction is Oregonator [831. This scheme involves an essential 
intransitivity related to the following cycle X^-Z^Y^-X^..., schematically depicted 
in Figure [Tj It should be noted that this cycle has to be powered by external sources of 
exergy (supply of reactant A and B in this case) since autonomous conversion of X into 
Z then into Y then into X is impossible due to transitive constraints of conventional 
thermodynamics. 

Although the Oregonator system involves only three active elements X, Y and Z, 
its cycle deviates from a regular cycle and has some features of the leaping cycle: the 
phase of rapid expansion X— >Z— 7>Y is followed by a slow decay of Y until the system 
loses stability and a new pulse of injection of X repeats the cycle. 

1.3. Oscillations in the scissors-paper-rock system 

Consider a system that has three states: 1) paper, 2) scissors and 3) rock. The 
competition rules are intransitive and given byl^2^3^1. No mutations are 
present in the system. The initial distribution is given by /(I) = /(2) = /(3) = 
1/3. This distribution is stationary due to the symmetry of the competition rules. 
According to Appendix [D] oscillations are expected in this system, while finite time 
steps make these oscillations mildly unstable. Figure [8] demonstrates evolution of this 
system. 

7.4. Intransitive competition and competitive cooperation 

The figures presented below are obtained from computer simulations of abstract 
competition. In these simulations, particle properties are represented by the vector 
y = {y^^\ y^'^\ y^^^)y which satisfies the conservation constraint y^^^ + y^^^ + y^^^ = 1 
and is interpreted as a combination of the primary colors: red, green and blue. 
The competition is controlled by the Condorcet rules representing the majority 
superposition of the following orderings: j/p*-* < yq^\ « = 1,2, 3 for every given couple 
p and q. These rules are locally intransitive and intransitive triplets y^^ y^^ 
can be found in a vicinity of any point p in the property space. The competition 
process is localised in the physical space. The physical domain is 2-dimensional and 
is mapped into a rectangle in the images presented here. None of the primary colors 
has any competitive advantages over the other primary colors but particles may have 
different overall competition strength with brighter colors performing on average better 
than the darker colors. Particle colors change according to the competition rules and 
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predominantly negative random mutations. Otherwise, there is no coordination of any 
kind over the particle properties. The competition rules and process parameters do not 
change during the simulations. The details of the methodology of these competitive 
simulations can be found in Ref. [5j . We stress that the complex behavior observed in 
these simulations is linked to intransitivity and localisation of the competition. 

The formation of a spot-like structure, which is observed in intransitive 
simulations with localisation of competition effective volume in physical space, reduces 
the intensity of competition. This reduction can be interpreted as a competitive 
cooperation between the particles. The particles of a dominant color manage to 
dominate collectively while reducing their overall competition effort. The intensity 
of competition is the average magnitude of adjustments of the properties of the losers 
S = 2Ep — Ypl /n, where the sum is taken over n/2 losing particles. There are two 
major factors that reduce the competition intensity. The competition is, obviously, 
less intense within a spot filled with similar colors than between the spots having very 
different colors. Within a spot, particles of different competitive strengths tend to 
compete at their own level of strength. 

The curves in Figure [o] represent the intensity of the primary colors y^^\ i — I 
(red), 2 (green) and 3 (blue) averaged over all particles and plotted versus the 
number of time steps. The simulations display leaping cycles: a color leaps into a 
dominant position of controlling the domain and manages to fend off competitors for 
a while, but ultimately reduces its competitiveness due to competitive degradation 
and loses competition to new challenges. The periods of clear dominance of a 
color are interchanged with periods of chaotic struggle without a clear winner or 
by periods of dominance of another color. The figure also presents configurations 
entropy Sc determined for A — 1, ranking Ru{[f]) = Ri[f], [/«]) relative to the uniform 
distribution = const and the intensity of competition S. It is clear that the loss 
of ranking Ru brings a more chaotic behaviour into the system - negative correlation 
between Sc and Ru is prominent. More chaotic behaviour tends to increase the 
intensity of competition S. Figure [TO] shows two consecutive states of the system 
(the property space on the left and the physical space on the right) when a newborn 
structure takes control over a chaotic behaviour and becomes highly dominant until it 
gradually weakens and loses its dominant position. Note the pyramid-like cooperative 
structures in the property space — within these structures the competition tends to 
be stratified and occur between particles with close properties and ranks. 

8. Summary and conclusions 

This work reviews existing publications and introduces a number of new results related 
to the application of non-conventional thermodynamics to turbulence, combustion and 
general non-equilibrium competitive processes involving different forms of mixing. 

8.1. Competitive mixing. 

The possibility of application of general principles of thermodynamics to competitive 
systems is reviewed and investigated. In its abstract form, competition is essentially 
a type of mixing, (i.e. competitive mixing), which can be effectively represented by 
a system of Pope particles and used to simulate a wide range of non-equilibrium 
processes including turbulent mixing and combustion. Although abstract competition 
should have a wide interdisciplinary range of applications, examples mentioned in this 
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work are mainly restricted to turbulent flows, chemical reactions and combustion, 
which are the author's prime areas of interest. In applications not related to 
turbulence, the concept of competitiveness represents a logical extension of the 
concepts of fitness and/or utility. Although abstract competition has been derived 
from a single field (turbulent combustion), it seems to represent an interdisciplinary 
approach linking distant fields and concepts (adiabatic accessibility and economic 
preferences may serve as an example). 

8.2. Competitive thermodynamics. 

Thermodynamic description of stochastic systems can be very useful and is repeatedly 
used in the literature but, in application to complex systems, thermodynamics does 
have its limitations discussed below. Entropy is the key quantity in thermodynamics, 
while the other thermodynamic properties are linked to the definition of entropy. 
During last decades it has become conventional to use the term entropy in different 
contexts, ranging from mathematics to social sciences. The same trend can be observed 
in studies of turbulent fiows, where different physical quantities may be implied under 
this term. In the present work we use the term "apparent" to distinguish entropy-like 
quantities from molecular entropy. 

We introduce a special type of random disturbances present in competition — 
the Gibbs mutations which possess certain Markov-like properties — and demonstrate 
that general principles of competition are consistent with thermodynamic description. 
Competitive entropy is subject to the competitive H-theorem presented in Appendix 
[D] a competitive system can also be characterised by another thermodynamic quantity 
— the competitive potential, which determines the likely direction of evolution of 
the system. A competitive system can be generally expected to stay in equilibrium 
or gradually increase its competitive potential over time. Contested resources tend 
to move between systems from lower to higher values of the competitive potential. 
In premixed combustion, products have higher entropy than the reactants and thus 
are more competitive. In the same manner, more competitive species invading areas 
occupied by less competitive species should be assigned a higher value of the effective 
entropy. Competitive thermodynamics recognises the obvious trend of moving towards 
more competitive states, irrespective of the exact nature of this competitiveness. The 
adiabatic accessibility approach, the theory of Gibbs measures and the principles 
of non-equilibrium thermodynamics should be mentioned here as important results 
preceding competitive thermodynamics. The overall rate of selection is linked to the 
frequency of positive mutations, which is constrained by the fiuctuation theorem and 
other thermodynamic parameters. 

The analogy with conventional thermodynamics is established first for Gibbs 
mutations but, if competition is transitive, any system with weakly positive mutations 
of a general nature would behave in a qualitatively similar manner to Gibbs systems: 
the system would quickly reach its quasi-equilibrium and then slowly escalate towards 
more competitive states until the point of maximal competitiveness is reached. After 
this, no further evolution can occur in the system as long as the external conditions 
remain fixed. In principle, a transitive competitive system, which is decoupled 
from molecular thermodynamics by an external source of exergy, may escalate its 
competitiveness indefinitely but, practically, there should be some physical limits on 
how high this competitiveness could be. Any equilibrium represents a balance between 
the forces of chaos and the forces of order. Thus, from the perspective of competitive 
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thermodynamics, some degree of order appearing out of chaos in competitive systems 
should be expected in the same way as more ordered crystaUinc states can appear in 
conventional thermodynamics under appropriate conditions. From the perspective of 
competitive thermodynamics, order appearing in some conventionally non-equilibrium 
competitive processes is, by itself, no more or less surprising than the possible presence 
of order in equilibrium states of conventional thermodynamics. 

8.3. Intransitivity. 

The main argument presented in this paper is, however, not about similarities of 
conventional and competitive thermodynamics, but about their differences. In the case 
of relatively simple systems, transitive competition and transitive thermodynamics 
produce a plausible picture of monotonic motion towards competitive equilibrium. 
This, however, does not seem to be consistent with the endlessly vigorous and 
often cyclic behaviour observed in complex competitive systems. However, if the 
competition rules are allowed to be intransitive, new types of complex behaviours 
emerge within the systems. The elements may form structures with a reduced 
level of competition within the structure (i.e. competitive cooperation) and struggle 
collectively to dominate the allowable space. Endless cyclic behaviour seems to 
become quite common under intransitive conditions: cooperative structures tend to 
survive and dominate for some time only to degrade at the end and be replaced by 
new structures. Intransitive systems can not be thermodynamically isolated, as this 
would immediately impose the transitive constrains of conventional thermodynamics, 
but require a relatively simple form of intervention — an external source of exergy. 
The choice in favour of considering intransitivities needs to be made not bcicausc; 
intransitivity can immediately explain all the complexities of the surrounding world 
but because transitive competition certainly cannot. This does not prevent many 
specific features from having perfectly transitive explanations, while intransitivity is 
associated with more complex effects. 

The early success of classical thermodynamics was associated with recognition of 
the irreversibility of the world around us, in spite of the time reversibility adopted by 
classical physics. It is difficult to make a general statement but abstract competition 
seems to point towards intransitivity, and the number of publications dedicated to 
different aspects of intransitivity is on the rise. We thus might have to face another 
difficult task of recognising the intransitivity of the surrounding world in contrast with 
the natural preference for the simplicity of the transitive description. In the transitive 
world, we have clear signposts: "strong" versus "weak", "fit" versus "unfit" and so 
on. The intransitive word is much more relativistic: a strategy that seems to be a big 
winner today may prove to be disastrous in a long run. We do not like intransitivities, 
not because they do not exist, but because they cause complications and it is generally 
difficult to treat them in a logical manner. This, however, is exactly the reason why 
intransitivities should be studied — they are responsible for the complexity of the 
world around us. The reasons behind the ubiquitousness of intransitivity seem to be 
quite transparent and very much similar to the reasons behind the Condorcet paradox: 
intransitivity is common when the simple outcome "is" or "is not" depends on many 
factors and criteria. A complex system is characterised by a multiplicity of rules; even 
if each rule is perfectly transitive, it is quite likely that a superposition of these rules 
is not. An element of a system may represent a system on its own (i.e. subsystem) 
while co-ranking of subsystems is inherently intransitive (see the example shown in 
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Figure |4]) . Another cause of intransitivity is that transitively weak elements tend to 
be removed by competition and further competition occurs in a more refined domain, 
where elements have similar ranks and intransitivities are likely. 

8.4- Unresolved problems. 

The theorems given in the Appendices establish major principles for evolution of 
competitive systems. It is worthwhile, however, to draw the attention of the reader 
to the immediate unresolved problems associated with intransitive behaviour. While 
competitive thermodynamics is useful when competition is intransitive but retains 
some transitive properties (such as being currently transitive or having a transitive 
component) or when mutations are not much different from Gibbs mutations, 
the feasibility of thermodynamic treatment of general mutations combined with 
general intransitivity is under the question mark. The analogy with conventional 
thermodynamics works well for simpler competitions but it seems to become less 
suitable for complex cases. 

Competitive degradations are an outcome of competition that seems abnormal 
from the perspective of apparent thermodynamics, but they appear to be possible in 
intransitive competitions. It seems that competitive cooperation, which also becomes 
possible in intransitive systems and is one of the key signs of complex behaviour, 
has a penalty of competitive degradation attached to the benefits of competitive 
cooperation. Establishing necessary and sufficient conditions for the existence of 
competitive degradations is an outstanding problem. 

8.5. Conclusion 

Competitive thermodynamics, whose concept has been derived from the modelling 
of turbulent combustion by competitive mixing, indicates that transitive evolution 
of competitive systems is generally consistent with conventional thermodynamic 
principles. Studies of complex behaviour in competitive systems, however, need 
to move beyond the principles of conventional thermodynamics in order to take 
into account intransitivity, which is commonly present in nature and seems to be 
responsible for complex cooperative behaviour. 
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APPENDICES 

A. Transitivity and absolute ranking 

This section gives a brief explanation of the mathematical terms and statements 
referred to in the main text. 
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A.l. Absolute ranking and Debreu theorem 

Consider totally and transitively pre-ordered sets in Euclidean space or in a complete 
separable metric space: 

• Totality implies that any two elements p and q are comparable, that is either 
Yp =4 Yq or y-p >p y^ or both of these relations are correct and yp ~ y^. 

• Pre-ordering, unlike ordering, allows for yp ~ y^ when yp and y, are not the 
same. 

• Transitivity is defined as the following property: yp =^ y^ and y^ =^ y^ always 
demands that yp ^ y^ for any p, q and r. 

• Continuity. Pre-ordering is continuous when the subsets ©^(y") = {y | y =^ y°} 
and S:>j(y°) = {y | y ^ y°} are closed for any y°; or equivalently when for any 
converging sequence yp, p = 1, 2. ... selected from the set, the boundedness of the 
sequence by yp ^ y° (or yp >p y°) demands the corresponding boundedness 
of the hmit yp -> yo as p oo by yo =^ y° (or yo ^ y°) for any y°. 
Physically, continuity of the ordering indicates a connection between ordering 
and the intrinsic metric of the space. 

• Absolute ranking, which is a scalar function 7'#(y) defined on the set, is 
equivalent to pre-ordering when r^(yp) <r^(yg) is equivalent to yp =^ y^ for 
any p and q. Ranking is called continuous when the function r^{y) is continuous. 

• Debreu theorem. The introduction of absolute ranking is subject to the 
Debreu theorem [521 IHl] which states that equivalent absolute ranking r^(yp) 
can be introduced for any transitive total pre-ordering provided the pre-ordering 
is continuous. The ranking can be selected to be continuous. 

Demonstrating the necessity of the continuity restriction imposed on pre-ordering 
is relatively easy. If the converging sequence yp — > yo as p — > oo is bounded by yp =^ y° 
then the equivalent continuous ranks Tp = r^(yp) are bounded by Vp < r° ^ ^^(y"). 
The ranks rp converge to "Tp — ^ = r^(yo) since the ranking function is continuous. 
It is clear that tq < r° , otherwise convergence of the ranks to tq is impossible. Hence, 
we conclude that yo =^ y°. The necessity of transitivity is also obvious. Indeed, let 
Yp ^ Yq ^ Yr ^ Yp be an intransitive triplet. For equivalent ranking we then have 
r#(yp) < r^{yq) < r^{yr) < r#(yp) and ranking in intransitive competition, if it 
exists, becomes a multivalued function. 

The sufficiency part of the theorem, which is much more difficult to establish, has 
been proved by Debreu [69l|84] for topological second-separable spaces. The results of 
Lieb and Yngvason [3] , who also postulated transitivity and continuity (although called 
the latter "stability") for pre-ordering by adiabatic accessibility that, are consistent 
with the Debreu theorem. 

The following examples illustrate the possibility or impossibility of absolute 
ranking: 

• Lexicographic ordering. The example of a transitive preordering that is 
not continuous and can not have an equivalent ranking has been given by 
Debreu [51]. Consider lexicographic ordering of the plane y = (y^^^y^^^)- Let 
Yp 4 Yq when, by definition, either y^^^ < y^^^ or y^^^ = y^^' and y^p '' < yf'' 
implying that yp — y^ when y^p^ = y'^q^ and j/p^-* = y'^q^ ■ The subsets 
6(2/^^') = {{y'^^\—oo < y'^'^^ < +00)} should have non-overlapping intervals 
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of ranks r^{@{yi))nr^{&{y2)) — when yi ^ j/2- Since there is a non-countable 
number of subsets &{y) and only a countable number of the intervals r^{&{yi)), 
equivalent ranking is impossible. 

• Countable sets. Equivalent ranking can always be introduced for any totally 
and transitively pre-ordered countable set. Let yi, y2, .■• be the counting sequence 
that, of course, is generally not coincident with the ordering sequence. The first 
element yi can be assigned any rank, say r^{yi) — 0. Assuming that equivalent 
ranks have been assigned to first k elements from the counting sequence, we can 
always select a rank, which is consistent with the previous k assignments, for the 
element numbered fc + 1. Repeating this procedure for the rest of the counting 
sequence assigns equivalent ranks to all elements. 

• Measure-based ranking. If a measure n is defined for the space under 
consideration, a relatively simple absolute ranking can be introduced for total 
transitive pre-ordering by 

'^M(y°) = M({y|y=^y°}) (33) 

From a practical perspective, the measure-based ranking may be sufficiently 
accurate but, generally, it does not represent an equivalent ranking and may 
coarsen the original pre-ordering; 

(i) if Yp ~ Yp then r^(yp) = r^(yp) 

(ii) if r^(yp) < r^(yg) then yp -< y, 

(iii) if r^(yp) = r^(yg) then yp -< y, or yp >- y, or yp ~ y, 
A. 2. Transitive closure 

This subsection gives a brief explanation of transitive closures, which are commonly 
used in the analysis of intransitive relations; for more details see other publications, 
[75j for example. The transitive closure defines a new transitive relation "^t" that is 
consistent as much as possible with a given intransitive relation . Transitive closure 
is minimal i.e. additional relations, which are not needed to establish transitivity of 
existing relations, are not included in the closure. If "=^" is transitive than "^t" 
coincides with . 

The closure involves several steps. For the sake of simplicity, we may presume that 
all elements are comparable so that elements in every pair are related by 'V 
or These relations are first expressed in terms of for example means 

but not ";?="• Second, yp =4t Yq is defined for any p and q that yp ^ y^. Third, 
the new relation is transitively extended to new elements: whenever yp =<!( y^ =4t Yr 
it is also set that yp y^. The third step is repeated as long as necessary until these 
extensions do not introduce any new relations. Finally, yp ~t yg is defined when 
Yp 4t Yq and yp y, (that is y, 4t Yp); while yp Yq is defined when yp =<;t y, 
but not yp yq. The defined closure is transitive by definition. 

The transitive closure divides all elements into one or more classes of equivalence 
£/ where yp ~t y^ when and only when p and q belong to the same class /. The classes 
are totally ordered by "^t" so that yp(/) yg(j)when and only when £/ £j, where 
p{I) denotes any p that belongs to class /. The transitive and intransitive relations 
are related to each other by: 

• Within each class any two elements p and q are part of at least one loop with a 
changing but finite number of elements 

yp ^ yi ^ y2 ^ ■•■ ^ ^ y'l ^ y2 ^ ■■• ^ yp (34) 
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where all elements belong to the same class ~t yi ~t ... ~t y, ~t y^ ~t ... ~t 
yp. The shortest possible loop has only two elements yp — yp. 

• The transitive relation coarsens the original relation , that is for any p and q 

(i) if yp ~ yp then yp ~t yp 

(ii) if yp Yq then yp ^ y, 

(iii) if yp ~t y, then yp -< y, or yp >- y, or yp ~ y. 



B. Relative ranking in preferential competitions 

This section gives a more general definition of ranking suitable for preferential mixing. 
These rankings are weighted by the preference function = 4'(yp,yg), which 
determines the probability of selecting the couple p, q for mixing. This function is 
presumed bounded < 4'(yp,yg) < 1. If mixing is non-preferential 5' = 1 for all 
particles; if particles p and q are isolated and can not mix yp j| y^ then '^pg = 0. 



B.l. Losing and winning capacities 

Relative ranking is related to losing and winning capacities. The generalised Heaviside 
step function 

if(y,y') = '*^ = |ry~^' (35) 

has the following properties 

H{Y,y') = l-H{y\y) (36) 

R{y,y')=H{y,y')-H{y',y), (37) 

We denote Hpg = H{yp,yg) and define winning and losing capacities of a particle by 
relationships 

h^iyp, [/]) = / nyp,yq)H{yp,yq)f{yq)dyg = ^J^'^pgHpg (38) 

q 

h-{yp, [/]) = / ^{yp,yq)H{yg,yp)f{yg)dyg = (39) 

q 

oo ^ 

Here, as an example, we give both the continuous and discrete forms, assuming that 

the distribution /(y<j) is represented by a large number of particles q = 1. ....n. The 
average winning capacity of one distribution /i(y) with respect to another /2(y) 

mfi], m = *(yi,y2)if(yi,y2)/i(yi)/2(y2)rfyidy2 (40) 

oo 

represents an average of /j'^(yi, [/2]) where yi is distributed with /i(yi) and y2 is 
distributed with /2(y2), while pi = 1, ni and p2 = 1, n2 run over particle groups 
representing distributions /i and /2 correspondingly. 
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B.2. Relative ranking and co-ranking 

The effective relative ranking of a particle is then given by 
where 

61 = /i+ - /i" and i/j = /i+ + /i" 

is the connectivity of particle p to distribution /(y): that is V' = 1 if rnixing is non- 
preferential and = if the particle is isolated from the distribution /(y) which 
can be expressed by y^ || [/]. Relative \I/-weighted ranking r indicates the strength 
of particle jp in competition with distribution /(y) and Vp = r{yp, [/]) may not be 
defined when y^ || [/]. 

The relative ranking (co- ranking) of two distributions /i (y) and /2 (y) is defined 

as 

^(IM- 1/^1)^ IS (-) 

where 

e([/i], m - ([/i], [/2]) - nm, [fi]) (43) 



and 



*([/i], m = H{[hl Ih]) + H{[hl [A]) (44) 

is mixing connectivity of these two distributions. If ^([/i],[/2]) = 0, distributions 
/i(y) and /2(y) are isolated [/i] || [/2] and particles from these distributions do not 
compete with each other. The equations given above generalise equations (19) (201 
for preferential mixing. 

B.3. Subsystem ranking 

If the distribution /(y) is divided into groups or subsystems / = 1, ...,K so that 

K 

/(y)-E«^'^/(y) (45) 

7=1 

where the distributions 4>i{'y) and constants o/ are normalised, i.e. 

K 



JSi 7=1 



Each group of particles is generally presumed to be a subsystem, which is confined to 
a certain domain J)/ distinctive for each subsystem. The ranking of subsystems can 
be introduced as 

Ri^Rmdf]) = ^ = ^Y.''J^"^" (46) 
^7 y^7 J 

ei = e{[(bj],[f]) = J2^j^ij (47) 
J 

§7 = 'i'([0,],[/]) = ^aj*/,7 (48) 
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where Rij represents the group co-ranking matrix 

- Rjl = Rij = R{[(t)ll = = ,T,.r , 1 r , 1^ (49) 

If the subsystems / and J are isolated [(/>/] || [(/>j] then ^/j = and co-ranking of 
these subsystems Rji is not defined. The possibihty of treating the subsystems as new 
competing super-elements should be mentioned. Complex systems can be expected to 
have a hierarchy of subdivisions. 



C. Mutations 



This section introduces Gibbs mutations that have some links with to Markov 
properties and Gibbs measures. Gibbs mutations are non-negative while near- 
Gibbs mutations can be infrequently positive. The distribution of infrequent 
positive mutations is analysed using thermodynamic considerations and the fluctuation 
theorem. 



C.l. Gibbs mutations 

The case of non-preferential mixing, where connections between Gibbs mutations, 
Markovian properties and Gibbs measures are most transparent, is considered first. A 
more general definition of Gibbs mutations for preferential mixing is given at the end 
of this subsection. 

Let /^(y, y°) be the probability distribution of mutations y — y° + C originating 
at state y°. Mutations we consider in this section are non-positive (i.e. y° + C, ^ y°) 
and is presumed to be free of singular components. The function 

Fdy,y°)^ r fdy\y°)dy' (50) 

specifies the probability that ranking falls down to r^(y) or below for mutations 
originating at y° . Note that Fi^{y,y°) = 1 for y >p y° since no positive mutations are 
allowed. In addition, the distributions of Gibbs mutations are required to satisfy the 
probability decomposition 

Fdy.y°) ^ Fdy,y')Fc{y\y°) (51) 

for any y ^ y' ^ y° . This condition can be interpreted as a Markov property. Indeed, 
consider mutations which occur continuously instead of a single jump and the motion 
down the ranks is terminated at a random moment. The Markov property requires 
that the termination moment depends only on the current location (and not on the 



state of origin of the mutation). With this property, equation (51) become almost 



obvious: in order to reach the state y from y° , a mutation needs to reach first the 



intermediate state y' and then proceed further to y. Differentiation of ( 51 ) with respect 
to y yields 

kM)-Pf^, (52) 

Fc[y',y°) 

Another useful interpretation is treating each mutation as a sequence yo,yi, ■■■Tyk 
of a large number k of small and stochastically independent steps Ay^ = — y^, 
i = 1, so that j/o = y° is the mutation origin and yk = y is its final state. Each 
step Ayi is associated with effective energy Ui so that step i occurs with probability 
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Xi — exp(— Mi) when and if the previous step i — 1 is completed. If the step i — 1 does 
not occur, then Ui is taken to be infinite and the probabiUty of step i is zero. Hence 
the probabihty of reaching and beyond is given by the exponent 

k k 

Fciyk,yo) = Y[Fciy^^yi~i) = exp(-^uj) (53) 

which can be interpreted as a Gibbs measure [2]. This demonstrates the existence of 
a hnk between Gibbs mutations and Gibbs measures. Note the functional consistency 



of the equations (22), ibll and (52) and (53). As Gibbs measures, Gibbs mutations 



can be introduced on mathematical trees but we can approach more complex cases 
with a more general (but perhaps less physically transparent) definition. 

Preferential mixing and mutations in more complex geometries need a more 
general approach to Gibbs mutations. The general definition of Gibbs mutations 
is given by the following expression for /^(y,y°) 

/c(y,y°) = •^°(y)^(y'y°) g(y°,y) (54) 

where /i[[(y°) = h'^{y°, [/o]) is introduced. These mutations are non-positive (y+C =^ 



y). Equation ([22| can be easily recovered from (54 1 under simplifying assumptions. 
The H-theorem given in Appendix [d] demonstrates that the function /o in ( 22 ) and 
in (54 1 is, in fact, the equilibrium distribution specified by ([t]). 

C.2. Fluctuation theorem 

Consider an isolated thermodynamic system, which is characterised by the entropy 
s{y) and by corresponding equilibrium distribution 

/(y)~exp(s(2/)) (55) 

The system changes its states though a random walk between the states 
yoi J/ii •■• by moving from the current node i to its neighbour i — 1 or i + 1 
with probabilities and af correspondingly. The detailed balance at equilibrium 
requires that 

fiat = fi ^ exp (si) (56) 

where fi is the discrete version of the equilibrium distribution and Si = s{yi). The 

■m 

exp (Asi) , Asj ^ Si+i - Si (57) 



condition ( 56 1 then takes the form 
aj ^ fi+i 

"r+i fi 

Let — >■ j, k) be the probability of transition from node j° to node j after exactly 
k steps (assuming of course that \j — j°\ < k). Each given sequence j° — > ... j 
can be reversed j ... j° and we may assume j > j° without loss of generality. 
The ratio of probabilities of these direct and reverse sequences is now evaluated. The 
direct sequence has j — j° increasing steps (i — > i + 1) and, possibly, a certain number 
of closed loops (i.e. subsequences that start and finish at the same location) while the 
reverse sequence has the j — j° of similar but decreasing steps (i + 1 — >■ «) and the 
exactly same number of the exactly same close loops as in the direct sequence. The 
ratio of probabilities becomes 

P(j° ^j,fc) ^ Pso P(j°^ ^ 
P(j^j°,fc) PsoP(i 
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= exp I ^ ^ Asi I = exp {sj — Sjo) (58) 



where Pso represents the probabihty of the all closed loops occurring in the sequence. 
Note that the ratio does not depend on the path and on k. The ratio then can be 
written in terms of probabilities of changing from entropy s° to entropy s and back 
ro/'so , s\ 

^ ^ exp (s - s°) (59) 



P (s ^ s< 

This equation is essentially the statement of the fluctuation theorem |57j applied to 
the case under consideration. 

The fluctuation theorem evaluates only the ratio of probabilities but not the 
probabilities P(s° — > s) and P (s — > s°) themselves. It is applicable to any stochastic 
process that can be considered as a limit of the random walk specified here. In case of 
a simple random walk the probabilities P (s° — >■ s) become normal after a large number 
of steps, in accordance with the central limit theorem. This, however, does not have 
to be the case for more general walks as considered below. 

C.3. Near-Gibbs mutations with exponential distributions 

The mutations analysed in this subsection are the near-Gibbs mutations, which are 
similar to Gibbs mutations but may be infrequently positive, that is y = y + C,^y 
in most cases but y y is also occasionally possible. Consider mutations that are 
generated by a random walk with a termination after a randomly chosen number of 
steps. We demonstrate that under some conditions discussed below, the probability 



distribution of these mutations becomes exponential and specified by (26). 

Let the mutations be represented by a random walk with stochastically similar 
steps and termination probability given by 1 — A, where < A < 1. The probability of 
each consequent time step is then A = exp(— u), where the exponential form with u is 



used according to the notations accepted for the Gibbs measures (53). The mutation 
^ can be represented by the sums 

m 

where all are stochastically equivalent and independent and m is a random integer 
value with the probability distribution 

P(m = fc) = A'''(1-^) (61) 
The variable ^ represents mutations y — y° + C originated at y° . 

The moment producing function of the random steps is given by 

T^{b) = {expm=Y.^b^ (62) 

i=0 

The moment producing function of k independent steps is 

T,(&) = ^exp ^ = (exp(60)' = (T^ib))' (63) 

The moment producing function for the variable C representing mutations is given by 

M = (!^^Pm = 1 + AT,(6) + X^T.ib) + ... = 
1 — A 1 — A 
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The value of A is presumed to be closed to 1 that is u is small. In this case the sequence 
involves many steps before termination and the universal limiting distribution of C can 
be determined. The function T^(6) can be expanded into a series to give 

1/A- 1 
1/A-l- (0 6- 

With the use of 



T^C(^) = 77^^ TIT, ieyvr. (65) 



1/A - 1 = exp(u) - 1 = M + ... (66) 



we observe that characteristic values of & in ( 65 1 are small when u is small. The leading 



order expression for the moment generating function becomes 

m = ^ (67) 

u 

which means that 

/(C) = &i exp (6iC) , &i = -|y (68) 

Without loss of generality, we imply that (0 is negative and C is predominantly 
negative while bi > 0. 

In special cases, when \ {^)\ is zero or small, equation for hi needs to be replaced 
by another equation 



^1 = (69) 



which is obtained by retaining the second moment (^^) in (65). If (0 ~ then 
h\ = (2m/ (C^))^/^ and the exponent for the positive mutations must be the same 
62 = 61 since the problem with {^) = is symmetric with respect to the substitution 
of -C for C- 

If (0 is not small then 62 becomes much larger than bi and evaluation of the 
distribution on the positive side becomes difficult — at the leading order the positive 
fluctuations are too small to be detected. The fluctuation theorem, nevertheless, allows 
to determine the probability distribution of positive mutations even if these mutations 



are very small and infrequent. Indeed, we may write the fluctuation theorem (59 1 in 
the form 



'(C-C°) f ds 

— exp ' ' 



(-^C°),-^=/^ (70) 



resulting in 



p(c = -n "V y ' dy 

/c(C) = ^^oCxp(-62C), C>0 (71) 
b2^bi+p (72) 



as suggested in equation (26). The value 13, which is expected to be positive for 
predominantly negative mutations, needs to be connected to the stochastic properties 
of the variable We can apply the fluctuation theorem to the distribution of ^ 



{-k°) (73) 
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which after multiplying by P = — and integrating over all ^° yields [27j 

(exp(^e)) = l (74) 

Thi s equation allows to determine (3. If ^ is small, then expanding the exponent in 
( 74 1 into a power series allows us to obtain the following explicit expression for $ : 



(75) 



Note that j3 is positive when ^ is predominantly negative. 

Convergence of a random walk distribution to the double-exponential distribution 



is shown in Figure 11 The walk involves random steps ^ = — 1 with probability 85% 
and ^ = +1 with probability 15%, while the termination parameter was set to A = 0.95. 
The solid line presents the numerical evaluation while the symbols show the expected 
double-exponential distribution. This distribution has around 4% positive mutations. 



D. Evolution of competitive systems 

D.l. Abstract competition 

Consider a large number of autonomous elements that possess two sets of properties 
a) non-conservative (information-like), b) conservative (energy-like) and, possibly, c) 
a set of physical coordinates. Abstract competition involves the following steps: 

(i) Selection. Random selection of elements to form competing couples, possibly 
with some preferences and/or isolations and possibly from the same locality in 
physical space. 

(ii) Competition. Determining the winner and the loser for each couple on the basis 
of the clement properties, possibly with some randomness. 

(iii) Conservative mixing. The conservative properties are redistributed on even 
basis or from the loser to the winner. The total amounts are preserved in this 
redistribution. 

(iv) Non-conservative mixing. The non-conservative properties are redistributed 
from the winner to the loser so that some or all non-conservative properties of 
the loser are lost. 

(v) Mutations. The redistribution of non- conservative properties may involve 
random changes (i.e. mutations), which are expected to be mostly detrimental to 
competitiveness of the elements. 

It appears that the abstract competition can be naturally represented by a system 
of Pope particles with competitive and conservative mixing. In the present work, the 
conservative properties are limited to the particles themselves, i.e. each particle has 
the conservative property of 1. Particles with finite life times can be considered if 
needed. 

D.2. Competitive pdf equation 

In the presence of mutations, the evolution equation for the pdf takes the form 

^ = 7 (M {h+iy, [/])/(y)) - h'iy, [/])/(y)) (76) 
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where and M is the mutation operator 

M (/(y)) = J /c(y, y°)/(y°)dy°, (77) 

CO 

/^(y,y°) is the normalised distribution of mutations originated from state y° and 
7 is the constant determining the overaU rate of mixing. The non-homogeneous 
terms present in the standard pdf equation Q are not included here since the case 
is presumed to be spatially homogeneous. This equation is a generalisation of the 
evolution equation derived in Ref. [5] and is quite transparent: h^{y, [/])/(y) is the 
total fraction of losers to the element y and h^{y, [/])/(y) is the total fraction of 
winners over the element y. The losers are subject to mutations originated at y while 
the winners remove particles from location y. 



D.3. Mutation-free evolution 

In the absence of mutations the rate of change of the distribution can be easily 
expressed in terms of relative ranking 

'-"^-lOiym), C-0 (78) 

where 7 is the constant determining the rate of mixing and 0(y,[/]) = ?'(y,[/])'0(y:[/])- 
We note that the cases where there is a draw do not change the properties when 
mutations are not present. 

In case of transitive competition of non-isolated particles, a steady state is possible 
only in a trivial case when all particles have the same rank (and thus Rpq = for 
any p and q). Indeed, any particle p, which has a rank Vp lower than that of the 
leader , would eventually lose competition to the leader and acquire the leading rank 
r*. The steady state is reached only when all particles are ranked at r*. A steady 
state with Rpq ^ is, however, possible for intransitive competition. For example, 
consider particles equally distributed between the three states in the scissors-paper- 
rock competition. This distribution is steady as the probabilities of losing a particle 
and gaining a particle are the same for all three states. Stability of non-trivial steady 
distributions in intransitive competitions is not guaranteed and needs to be examined. 



Equation ( 78 1 indicates that in absence of mutations any stationary solution 
requires 0(y,[/o]) = for any y such that /(y) > 0. Consider variation Sf{y) — 
/(y) " fo{y)i whose support is not larger than that of /o(y) (that is Sf{y) — for 
all y that /(y) — 0) then within the support of /o(y) we have 9{y, [fo]) = and 

e{y, [/]) = 0{y, [fo + Sf]) = 0{y, [/o]) + 0{y, [5f]) = 6{y, [5f]) (79) 

The linearised form of equation ( [78| is 

^^=iMy)0{y\5f]) (80) 

With the use of Sf{y) = '5/(y)//o(y)^^^ this equation can be written as 

^=7L/5/ (81) 
where is a linear operator applied to Sf and defined by 

L/^(y)- [^{y,y')R{y,y')Sf{y')^JW(y)dy' (82) 
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The positiveness of /o(y) for all y where Sf{y) ^ must be noted. The operator L/ 
is skew-symmetric (anti-symmetric) 

5/ (y)L;?/(y)dy = (83) 



due to i?(y,y') = — i?(y',y). The solution of equation (81) with initial conditions 
^/(y) = '5/°(y) at i = is given by 

5/(y) ^ exp(7<L/)^(y) (84) 

where the exponential operator is unitary. Hence, unless R^q = for all particle 
couples p and the system of competing particles without mutations has non-decaying 
oscillations. Generally, negative mutations tend to act as a stabilising factor while 
positive mutations tend to be destabilising. 

D.J^. Nearly mutation-free evolution 

Consider the overall steady distribution /(y), represented by a superposition of 
ajcf)j{y), where (f>j{y) is the distribution of particles within one of the subsystems 



1=1, ...,K located in domains 3/ as specified by (45). The major changes in the 
system occur due to the competition between the subsystems, which does not involve 
mutations, while smaller adjustments of distributions happen due to competitions 
within each subsystem and may involve some non-positive mutations. The distribution 
/(y) is, initially, at equilibrium. 

If competition is transitive and the subsystem leaders y/* are not isolated from 
each other, then any non-trivial steady distribution is impossible. Indeed, once a 
subsystem leader has lost competition to a leader from another subsystem, it cannot 
be replaced due to absence of mutations between subsystems and absence of positive 
mutations within the subsystem. The system keeps evolving until only one subsystem 
is left. A non-trivial steady state, however, is possible in intransitive competition. 

Let us consider linear stability of the equilibrium with respect to the disturbance, 
which is represented by small changes in a/ while 4>j{y) are not changed initially 
and remain the same within accuracy of our analysis. In the absence of mutational 
exchanges between the subsystem, this leads to the relation 

^ -7e/([/])a/ = 7E"^«^Q^'^ (85) 



which can be obtained from ( 76 1 by integrating / over each of the subsystem domains 
S)/ under assumptions that 4'j{y) (and consequently 6/j) are at equilibrium and do 
not change in time and that domains J)/ do not exchange mutations. 



Since /(y) is steady, equation (851 indicates that O/a/ = 0. We investigate 
stability of the system with respect to changes of every a/ 7^ and 8/ = by Aa/ 
assuming that 4>i{y) do not change that is A/(y) = T,i(j)j{y)Aai. Note that if aj = 0, 



competition without mutations does not allow to change this value. Equation ( 85 1 
takes the form 

^ = 7a/Ae/ = 7a/ J2 ^ijAaj (86) 
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With Aa/ — Aaj / Oj the hnearised version of this equation takes the form 

^ = J2 LiJ^aj = KAai (87) 

,7=1 

where the Unear operator L^, is represented by the skew-symmetric matrix 

J- 1/2^ 1/2 

^77 = a/ BijaJ 



Note that a/ > for any / that Aa/ > 0. The solution of equation (87) with initial 
conditions Aa/ — Aoj at i = is 

K 

Aa/ = exp(7tLa)A^J (89) 
J=i 

where the matrix exponent exp(7tLa) produces a unitary matrix. Hence, unless 
Qjj = Rij'^ij = for every / and J, a deviation from the steady state is expected 
to generate oscillations in the system. Equilibration of two non-isolated subsystems / 
and J in the absence of mutational exchanges between the subsystems needs Rjj = 
rather than equivalence of the competitive potentials. 

D.5. Competitive H-theorem 

The competition considered here can be transitive or intransitive, preferential or non- 
preferential. Mutations are represented by Gibbs mutations satisfying formula (54). 

Theorem 1 The total entropy of a competitive system with non-positive Gibbs 
mutations monotonically increases during evolution of the system until it reaches its 
maximal value at the equilibrium. 



For mutations distributed according to equation ( 54 ) , the governing equation ( 76 ) 
takes the form 

g/(yi) ^ 
dt 

7 / i?(y2,yi)*(yi,y2)7$7^ {Myi)h+{y2, [/]) - f{yi)h+{y2)) dy^ 
J f^o (y2j 

oo 

= 7/ / *3(yi,y2,y3)(/o(yi)/(y3) - /(yi)/o(y3))dy3rfy2 (90) 



v(yi,y3) 



where 



f(V2) 

$3(yi,y2,y3) = g(y2, yi)^(yi, y2)g(y2, y3)^(y3, y2) . +\ \ > 

Evaluation of the time derivative for the entropy defined by 

^([/(y)]) = - £ /(y) In (1^) dy+Co([/o(y)]) (9i) 

results, after substitution of (|90l, in 



dt J dt V/o(yi) 
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yj J y"*3(yi,y2,y3)¥'(yi,y3)in (^-^^^^dyidysdys 



*2(yi,y3) 

f f f x*2(yi,y3) + ^2(y3,yi) , , , 

/ *3(yi,y2,y3) — ^ ^ -dyidy2dy3 (92) 

oo 

Here, we use the symmetric properties $3(yi;y2,y3) = ^3(y3,y2!yi) of the function 
$3 while noting that the variables yi and ya are dummy integration variables and can 
be swapped in the integral. With the use the expression 

*2(yi,y3) + ^2(y3,yi) = 

-/o(yi)/(y3)(w-l)ln(a;)<0 (93) 
and antisymmetry of the function 

</^(yi,y3) = -<^(y3,yi) 

while introducing oj by 

^ ^ /(y3) /o(yi) 
/o(y3) /(yi) 

and noting that (uj — 1) ln(u;) > 0, we obtain the relation 



/ / /*3(yi,y2,y3)/o(yi)/(y3) (w - I)ln(w)dyidy2dy3 



= f>0 («) 
proving the H-theorem. 

D. 6. Convergence theorem for transitive competition 

The mutations considered in this subsection are deemed to be general non-positive 
mutations (rather than Gibbs mutations), although our analysis is restricted to 
transitive competition. Consider competition within a closed domain D that has 
a finite measure (i.e. volume) ^(2)) < oo and assume that the mutation distribution 
function /^(y,y°) is continuous in this domain. The mixing is assumed to be 
non-preferential (\1/ = 1). The absolute ranking r^(y) is continuous and satisfies 
additional continuity requirement /z(S)2(ri,ri + Arj) — >• as Ar — >■ uniformly in 
53. Here we define £'2(^1, ^2) = {y\ri<r^{y)<r2} and, analogously, S2(yi.y2) = 
{y|yi=^ y =^ y2}- For the mathematical space of continuous functions /(y) defined on 
D and conventionally denoted by C''(2)), the norm of / can be specified by 

11/11 = max (|/(y)|) (95) 
yes 

The mathematical restrictions considered here are introduced to keep the proof 
transparent and, in principle, can be modified or relaxed. 
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Theorem 2 // competition is transitive and mutations are non-positive, the system 
asymptotically approaches its equilibrium state where the total entropy of the system 
reaches its maximal value. 



If mutations are non-positive, the governing equation ( 76 ) takes the form 

dfjy) ^ 
dt 

7 1 i/(y°,y) (/c(y,y°)(l - h-iy°, [/])) - /(y)) /(y°)dy° (96) 

■s 

implying that for any yi the evolution of the distribution in the region y ^ yi does 
not depend on the distribution in the region y ^ yi- If a stationary solution is reached 
for y ^ yi, it will remain in this state although /(y) may still evolve at y ^ y^^. we 
can formally rewrite equation ([96]) in the form 

^ = J^' /c(y,y°) (1 - h-{y'', [/])) /(y°)dy° 

-h'iy,[f])f{y) (97) 



where 



The limits in this equation imply that the integral is evaluated over the region 
S2(y,y*) where y* is the location of the leading particle. Note that the regions 
S2(yi,yi) have a zero measure for any yi. 

If the steady solution is established in the region 2)2 (yi, y*) but not in the region 
D2(y, y^), which is presumed to be small as y is taken close to yi, a steady state must 
be established in the second region as it is effectively controlled by the first region and 
mutations in a small region can always be deemed close to being Gibbs mutations. 

The integral in (97) can be divided into several terms 

df 

^ = 7Q0 + 7Qi(/) - 7Q2(/) - 7V(yi)/(y) (99) 

where 

'^'/c(y,y°)(i-V(y°))/o(y°)rfy° 

yi 

Qi(/) = r /c(y,y°)(i - h-(y°, [/]))/(y°)dy° 

Q2(/) = /(y) {h-iy, [/]) - V(yi)) = /(y) /(y°)dy° 

"'y 

and seek a solution in form of the time steps 
/(y,t + A<) = 

f{y,t) (1 - V(yi)7Ai) + lAt (go + Qi(/) - Q2(/)) (100) 
The norms of the operators Qi and Q2 can be easily estimated by 

IIQi||<II/cIIaMa 
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IIQ2II <2||/|UAi^ 

where 

Ma = M(S2(y,yi)) 

is the measure of the region S2(y,yi) and the norms subscribed by A are evaluated 
over 2)2(y,yi)- The norm of operators Qi and Q2 can be made smaller than any 
given £ > by selecting (y) sufficiently close to (but still at a finite distance from) 
r#(yi). The leading order estimate of the stationary distribution on S)2(y,yi) is 
given by /o « Qo/h^ (yi), constraining the norms of the converging distributions 
(assuming reasonable initial conditions). Since Qo does not depend on / and the 
norms of the operators Qi and Q2 are relatively small, the operator on the right-hand 
side of equation (D.25) becomes a contraction mapping (provided e is selected so that 
£ < /i{7(yi) and the time step At is sufficiently small). This proves convergence and 
uniqueness of the solution. 

Note that e can be selected uniformly over the domain with the exception of the 
vicinity of the leading particle where (y) — >■ as y — >■ y^ . One may also notice that 
df{y)/dt -H- as y y^. The vicinity of leading particle needs special consideration 
that takes into account the discrete nature of the particle system. The position of the 
leading particle is fixed and we need to consider the distribution behind the leading 
particle where ft-(7(y) > 1/n is positive, where n is the total number of particles. The 
singularity of (y) — )■ as y — y^ indicates that convergence to a steady solution in 
the leading group is not uniform and can be quite slow. Indeed, let two particles p and 
q be initially located at y*. This distribution is not at equilibrium since eventually, 
after certain characteristic time , these two particles would form a mixing couple and 
one of them is destined to leave the leading position. If the total number of particles 
n is very large, the deviation from the equilibrium is small but the time can be very 
large. 



As / — > /o, the entropy defined by (91 1 approaches its maximal value; the 



theorem, however, does not guarantee that this process is monotonic. 
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Figure 1: Evolution of configurational entropy Sc in homogeneous turbulence 
simulated by mapping closure (solid line) and by modified Curl's model (dotted line) 
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Figure 2: Change in entropy of mixing s{y) induced by Curl's mixing 




REFERENCES 



52 



Figure 3: Quasi-equilibrium distributions for infrequently (4%) positive mutations 
(dashed line - double-exponential mutations; dash-dotted line - shifted exponential 
mutations) and equilibrium distributions for non-positive mutations (solid line - 
numerical simulations; circles - exponential distribution ) 




Figure 4: Competitive version of the Condorcet paradox: an example of intransitivity 
of group co-ranking [f^] ~< [/g] ^ [f^] ~< [/a] occuring when the underlying 
competition is strictly transitive and determined by absolute ranking r^. Competition 
is presumed to be non-preferential. The square demonstrates that [/g] -< [Jq] since B 
wins over C only in 4/9 of all cases. 




REFERENCES 

Figure 5: Current transitivity in completely intransitive competition. 
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Figure 6: Intransitivity of energy exchange between Reynolds stresses in turbulent 
shear flows 
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Figure 7: Intransitivity of the Oregonator model [53] for the Belousov-Zhabotinsky 
reaction. 
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Figure 9: Average intensity of colours indicating leaping cycles, average relative rank 
configurational entropy Sc and average intensity of competition S indicating the 
level of competitive cooperation in intransitive abstract competition. The vertical 
dashed line shows location of images displayed in the next Figure. 
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Figure 10: Order appearing out of chaos: the red spot gradually asserts its dominance 
over the domain that previously was in a state of chaos. The blue spot on the 
left attempts to launch a competitive bid for dominance but ultimately fails. Two 
consecutive frames of this process are shown. The property space is shown in the left 
column of figures while corresponding physical spaces are shown in the right column. 
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Figure 11: Simulated (solid line) and predicted (symbols) double exponential 

distribution of mutations obtained as a limit of the random walk with interruptions. 
The bottom figure shows the same distribution as the top figure but using a logarithmic 
ordinate. 
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